2023-02-16 14:00:42,461 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-16 14:00:42,502 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=162, AvailableMemoryMB=5282 2023-02-16 14:00:42,747 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f 2023-02-16 14:00:42,753 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:00:42,754 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce, deleteOnExit=true 2023-02-16 14:00:42,754 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:00:42,754 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/test.cache.data in system properties and HBase conf 2023-02-16 14:00:42,755 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:00:42,755 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:00:42,756 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:00:42,756 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:00:42,756 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:00:42,834 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-16 14:00:43,144 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:00:43,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:00:43,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:00:43,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:00:43,149 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:00:43,149 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:00:43,149 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:00:43,149 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:00:43,150 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:00:43,150 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:00:43,150 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:00:43,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:00:43,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:00:43,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:00:43,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:00:43,547 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:00:43,550 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:00:43,780 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-16 14:00:43,907 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-16 14:00:43,918 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:00:43,951 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:00:43,989 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/java.io.tmpdir/Jetty_localhost_localdomain_38425_hdfs____6cgzik/webapp 2023-02-16 14:00:44,110 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38425 2023-02-16 14:00:44,121 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:00:44,121 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:00:44,559 WARN [Listener at localhost.localdomain/40397] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:00:44,631 WARN [Listener at localhost.localdomain/40397] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:00:44,653 WARN [Listener at localhost.localdomain/40397] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:00:44,661 INFO [Listener at localhost.localdomain/40397] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:00:44,673 INFO [Listener at localhost.localdomain/40397] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/java.io.tmpdir/Jetty_localhost_41769_datanode____ecpslg/webapp 2023-02-16 14:00:44,786 INFO [Listener at localhost.localdomain/40397] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41769 2023-02-16 14:00:45,223 WARN [Listener at localhost.localdomain/37805] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:00:45,291 WARN [Listener at localhost.localdomain/37805] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:00:45,294 WARN [Listener at localhost.localdomain/37805] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:00:45,296 INFO [Listener at localhost.localdomain/37805] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:00:45,307 INFO [Listener at localhost.localdomain/37805] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/java.io.tmpdir/Jetty_localhost_44215_datanode____.3e4343/webapp 2023-02-16 14:00:45,426 INFO [Listener at localhost.localdomain/37805] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44215 2023-02-16 14:00:45,436 WARN [Listener at localhost.localdomain/44383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:00:45,666 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88f3d56c0cce3e32: Processing first storage report for DS-d97a700d-20b8-46a5-a552-d94f5a859953 from datanode ed3561d4-5c37-4310-baf7-f9db6fd390fd 2023-02-16 14:00:45,667 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88f3d56c0cce3e32: from storage DS-d97a700d-20b8-46a5-a552-d94f5a859953 node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=ed3561d4-5c37-4310-baf7-f9db6fd390fd, infoPort=44403, infoSecurePort=0, ipcPort=44383, storageInfo=lv=-57;cid=testClusterID;nsid=576079097;c=1676556043606), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 14:00:45,668 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88f3d56c0cce3e32: Processing first storage report for DS-68262948-cf6a-4215-8e20-c5d2d0fd2c89 from datanode ed3561d4-5c37-4310-baf7-f9db6fd390fd 2023-02-16 14:00:45,668 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88f3d56c0cce3e32: from storage DS-68262948-cf6a-4215-8e20-c5d2d0fd2c89 node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=ed3561d4-5c37-4310-baf7-f9db6fd390fd, infoPort=44403, infoSecurePort=0, ipcPort=44383, storageInfo=lv=-57;cid=testClusterID;nsid=576079097;c=1676556043606), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:00:45,670 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bea0858ba22b9fe: Processing first storage report for DS-c7a15f7e-a9cd-453d-8037-7738379ebeed from datanode c35c3670-7cad-47da-ba12-de04c543d8c0 2023-02-16 14:00:45,670 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bea0858ba22b9fe: from storage DS-c7a15f7e-a9cd-453d-8037-7738379ebeed node DatanodeRegistration(127.0.0.1:42325, datanodeUuid=c35c3670-7cad-47da-ba12-de04c543d8c0, infoPort=34665, infoSecurePort=0, ipcPort=37805, storageInfo=lv=-57;cid=testClusterID;nsid=576079097;c=1676556043606), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:00:45,670 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bea0858ba22b9fe: Processing first storage report for DS-97752e5f-a660-4479-b182-b00289293db1 from datanode c35c3670-7cad-47da-ba12-de04c543d8c0 2023-02-16 14:00:45,671 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bea0858ba22b9fe: from storage DS-97752e5f-a660-4479-b182-b00289293db1 node DatanodeRegistration(127.0.0.1:42325, datanodeUuid=c35c3670-7cad-47da-ba12-de04c543d8c0, infoPort=34665, infoSecurePort=0, ipcPort=37805, storageInfo=lv=-57;cid=testClusterID;nsid=576079097;c=1676556043606), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:00:45,792 DEBUG [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f 2023-02-16 14:00:45,871 INFO [Listener at localhost.localdomain/44383] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/zookeeper_0, clientPort=49697, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:00:45,888 INFO [Listener at localhost.localdomain/44383] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49697 2023-02-16 14:00:45,899 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:45,902 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:46,562 INFO [Listener at localhost.localdomain/44383] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced with version=8 2023-02-16 14:00:46,562 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:46,564 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:46,567 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/hbase-staging 2023-02-16 14:00:46,854 INFO [Listener at localhost.localdomain/44383] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-16 14:00:47,241 INFO [Listener at localhost.localdomain/44383] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:00:47,269 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,269 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,270 INFO [Listener at localhost.localdomain/44383] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:00:47,270 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,270 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:00:47,412 INFO [Listener at localhost.localdomain/44383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:00:47,475 DEBUG [Listener at localhost.localdomain/44383] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-16 14:00:47,559 INFO [Listener at localhost.localdomain/44383] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46779 2023-02-16 14:00:47,568 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,570 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,591 INFO [Listener at localhost.localdomain/44383] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46779 connecting to ZooKeeper ensemble=127.0.0.1:49697 2023-02-16 14:00:47,631 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:467790x0, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:00:47,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46779-0x1016b96cfca0000 connected 2023-02-16 14:00:47,657 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:00:47,658 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:00:47,661 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:00:47,668 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46779 2023-02-16 14:00:47,668 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46779 2023-02-16 14:00:47,669 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46779 2023-02-16 14:00:47,669 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46779 2023-02-16 14:00:47,670 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46779 2023-02-16 14:00:47,676 INFO [Listener at localhost.localdomain/44383] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced, hbase.cluster.distributed=false 2023-02-16 14:00:47,741 INFO [Listener at localhost.localdomain/44383] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:00:47,741 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,742 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,742 INFO [Listener at localhost.localdomain/44383] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:00:47,742 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,742 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:00:47,746 INFO [Listener at localhost.localdomain/44383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:00:47,749 INFO [Listener at localhost.localdomain/44383] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33377 2023-02-16 14:00:47,752 INFO [Listener at localhost.localdomain/44383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:00:47,759 DEBUG [Listener at localhost.localdomain/44383] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:47,760 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,762 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,764 INFO [Listener at localhost.localdomain/44383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33377 connecting to ZooKeeper ensemble=127.0.0.1:49697 2023-02-16 14:00:47,768 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:333770x0, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:00:47,769 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:333770x0, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:00:47,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33377-0x1016b96cfca0001 connected 2023-02-16 14:00:47,771 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:00:47,772 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:00:47,772 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33377 2023-02-16 14:00:47,772 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33377 2023-02-16 14:00:47,773 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33377 2023-02-16 14:00:47,773 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33377 2023-02-16 14:00:47,775 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33377 2023-02-16 14:00:47,785 INFO [Listener at localhost.localdomain/44383] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:00:47,785 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,786 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,786 INFO [Listener at localhost.localdomain/44383] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:00:47,786 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:00:47,786 INFO [Listener at localhost.localdomain/44383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:00:47,786 INFO [Listener at localhost.localdomain/44383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:00:47,788 INFO [Listener at localhost.localdomain/44383] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44247 2023-02-16 14:00:47,788 INFO [Listener at localhost.localdomain/44383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:00:47,790 DEBUG [Listener at localhost.localdomain/44383] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:47,791 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,793 INFO [Listener at localhost.localdomain/44383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:47,796 INFO [Listener at localhost.localdomain/44383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44247 connecting to ZooKeeper ensemble=127.0.0.1:49697 2023-02-16 14:00:47,802 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:442470x0, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:00:47,803 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:442470x0, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:00:47,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44247-0x1016b96cfca0002 connected 2023-02-16 14:00:47,804 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:00:47,805 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:00:47,806 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44247 2023-02-16 14:00:47,807 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44247 2023-02-16 14:00:47,807 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44247 2023-02-16 14:00:47,809 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44247 2023-02-16 14:00:47,810 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44247 2023-02-16 14:00:47,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:47,823 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:00:47,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:47,845 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:00:47,845 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:00:47,845 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:00:47,846 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:47,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:00:47,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,46779,1676556046719 from backup master directory 2023-02-16 14:00:47,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:00:47,853 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:47,853 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:00:47,855 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:00:47,855 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:47,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-16 14:00:47,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-16 14:00:47,944 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/hbase.id with ID: 8cfc9f97-dc34-48df-ad67-d642ad98df74 2023-02-16 14:00:47,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:00:48,003 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:48,056 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5f5dc7ae to 127.0.0.1:49697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:00:48,096 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698ac56b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:00:48,120 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:00:48,122 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:00:48,138 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-16 14:00:48,138 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-16 14:00:48,140 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 14:00:48,144 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 14:00:48,145 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:00:48,175 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store-tmp 2023-02-16 14:00:48,206 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:48,206 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:00:48,207 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:00:48,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:00:48,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:00:48,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:00:48,207 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:00:48,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:00:48,210 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/WALs/jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:48,231 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46779%2C1676556046719, suffix=, logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/WALs/jenkins-hbase20.apache.org,46779,1676556046719, archiveDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/oldWALs, maxLogs=10 2023-02-16 14:00:48,283 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK] 2023-02-16 14:00:48,283 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK] 2023-02-16 14:00:48,291 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-16 14:00:48,353 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/WALs/jenkins-hbase20.apache.org,46779,1676556046719/jenkins-hbase20.apache.org%2C46779%2C1676556046719.1676556048240 2023-02-16 14:00:48,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK], DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK]] 2023-02-16 14:00:48,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:00:48,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:48,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,419 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,426 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:00:48,451 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:00:48,463 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:48,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,472 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,490 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:00:48,494 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:48,495 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73653751, jitterRate=0.097526416182518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:00:48,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:00:48,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:00:48,516 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:00:48,516 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:00:48,518 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:00:48,520 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-16 14:00:48,550 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 29 msec 2023-02-16 14:00:48,550 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:00:48,576 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:00:48,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:00:48,608 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:00:48,612 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:00:48,614 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:00:48,619 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:00:48,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:00:48,626 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:48,629 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:00:48,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:00:48,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:00:48,648 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:00:48,648 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:00:48,648 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:48,648 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:00:48,651 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,46779,1676556046719, sessionid=0x1016b96cfca0000, setting cluster-up flag (Was=false) 2023-02-16 14:00:48,670 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:48,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:00:48,676 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:48,695 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:48,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:00:48,721 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:48,724 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/.tmp 2023-02-16 14:00:48,814 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(952): ClusterId : 8cfc9f97-dc34-48df-ad67-d642ad98df74 2023-02-16 14:00:48,814 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(952): ClusterId : 8cfc9f97-dc34-48df-ad67-d642ad98df74 2023-02-16 14:00:48,819 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:00:48,819 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:00:48,825 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:00:48,825 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:00:48,826 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:00:48,826 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:00:48,828 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:00:48,828 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:00:48,830 DEBUG [RS:0;jenkins-hbase20:33377] zookeeper.ReadOnlyZKClient(139): Connect 0x35bafbd1 to 127.0.0.1:49697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:00:48,831 DEBUG [RS:1;jenkins-hbase20:44247] zookeeper.ReadOnlyZKClient(139): Connect 0x0e8677be to 127.0.0.1:49697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:00:48,845 DEBUG [RS:0;jenkins-hbase20:33377] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70b86302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:00:48,846 DEBUG [RS:1;jenkins-hbase20:44247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b791d3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:00:48,846 DEBUG [RS:0;jenkins-hbase20:33377] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b54222c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:00:48,847 DEBUG [RS:1;jenkins-hbase20:44247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@194ad490, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:00:48,870 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:44247 2023-02-16 14:00:48,873 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:33377 2023-02-16 14:00:48,875 INFO [RS:0;jenkins-hbase20:33377] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:00:48,875 INFO [RS:1;jenkins-hbase20:44247] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:00:48,876 INFO [RS:1;jenkins-hbase20:44247] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:00:48,876 INFO [RS:0;jenkins-hbase20:33377] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:00:48,876 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:00:48,876 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:00:48,878 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,46779,1676556046719 with isa=jenkins-hbase20.apache.org/148.251.75.209:33377, startcode=1676556047740 2023-02-16 14:00:48,878 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,46779,1676556046719 with isa=jenkins-hbase20.apache.org/148.251.75.209:44247, startcode=1676556047785 2023-02-16 14:00:48,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:00:48,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:00:48,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:00:48,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:00:48,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:00:48,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:00:48,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:48,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:00:48,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:48,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556078893 2023-02-16 14:00:48,894 DEBUG [RS:0;jenkins-hbase20:33377] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:00:48,894 DEBUG [RS:1;jenkins-hbase20:44247] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:00:48,897 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:00:48,897 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:00:48,898 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:00:48,903 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:00:48,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:00:48,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:00:48,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:00:48,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:00:48,923 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:00:48,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:48,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:00:48,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:00:48,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:00:48,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:00:48,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:00:48,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556048953,5,FailOnTimeoutGroup] 2023-02-16 14:00:48,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556048953,5,FailOnTimeoutGroup] 2023-02-16 14:00:48,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:48,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:00:48,954 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:00:48,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:48,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:48,957 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:00:48,957 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced 2023-02-16 14:00:48,963 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46525, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:00:48,963 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32833, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:00:48,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:48,980 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46779] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:48,989 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:48,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:00:48,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/info 2023-02-16 14:00:48,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:00:49,001 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced 2023-02-16 14:00:49,001 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40397 2023-02-16 14:00:49,001 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:00:49,002 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced 2023-02-16 14:00:49,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,002 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40397 2023-02-16 14:00:49,002 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:00:49,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:00:49,005 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:00:49,007 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:00:49,007 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:00:49,008 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,009 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:00:49,009 DEBUG [RS:0;jenkins-hbase20:33377] zookeeper.ZKUtil(162): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,009 WARN [RS:0;jenkins-hbase20:33377] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:00:49,010 INFO [RS:0;jenkins-hbase20:33377] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:00:49,010 DEBUG [RS:1;jenkins-hbase20:44247] zookeeper.ZKUtil(162): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,010 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,010 WARN [RS:1;jenkins-hbase20:44247] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:00:49,011 INFO [RS:1;jenkins-hbase20:44247] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:00:49,011 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,010 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33377,1676556047740] 2023-02-16 14:00:49,012 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44247,1676556047785] 2023-02-16 14:00:49,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/table 2023-02-16 14:00:49,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:00:49,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,021 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740 2023-02-16 14:00:49,023 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740 2023-02-16 14:00:49,025 DEBUG [RS:1;jenkins-hbase20:44247] zookeeper.ZKUtil(162): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,026 DEBUG [RS:1;jenkins-hbase20:44247] zookeeper.ZKUtil(162): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,027 DEBUG [RS:0;jenkins-hbase20:33377] zookeeper.ZKUtil(162): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,028 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:00:49,028 DEBUG [RS:0;jenkins-hbase20:33377] zookeeper.ZKUtil(162): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,030 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:00:49,035 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:49,035 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75174380, jitterRate=0.12018555402755737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:00:49,036 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:00:49,036 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:00:49,036 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:00:49,036 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:00:49,036 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:00:49,036 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:00:49,037 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:00:49,037 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:00:49,039 DEBUG [RS:0;jenkins-hbase20:33377] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:00:49,039 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:00:49,043 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:00:49,043 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:00:49,051 INFO [RS:1;jenkins-hbase20:44247] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:00:49,051 INFO [RS:0;jenkins-hbase20:33377] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:00:49,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:00:49,063 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:00:49,066 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:00:49,077 INFO [RS:0;jenkins-hbase20:33377] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:00:49,077 INFO [RS:1;jenkins-hbase20:44247] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:00:49,081 INFO [RS:0;jenkins-hbase20:33377] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:00:49,081 INFO [RS:1;jenkins-hbase20:44247] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:00:49,082 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,082 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,082 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:00:49,083 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:00:49,091 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,091 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,091 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,091 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,092 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,093 DEBUG [RS:0;jenkins-hbase20:33377] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,093 DEBUG [RS:1;jenkins-hbase20:44247] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:00:49,095 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,096 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,096 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,096 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,096 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,096 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,114 INFO [RS:1;jenkins-hbase20:44247] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:00:49,114 INFO [RS:0;jenkins-hbase20:33377] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:00:49,117 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44247,1676556047785-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,117 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33377,1676556047740-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,133 INFO [RS:1;jenkins-hbase20:44247] regionserver.Replication(203): jenkins-hbase20.apache.org,44247,1676556047785 started 2023-02-16 14:00:49,133 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,44247,1676556047785, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44247, sessionid=0x1016b96cfca0002 2023-02-16 14:00:49,133 INFO [RS:0;jenkins-hbase20:33377] regionserver.Replication(203): jenkins-hbase20.apache.org,33377,1676556047740 started 2023-02-16 14:00:49,133 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:00:49,134 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33377,1676556047740, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33377, sessionid=0x1016b96cfca0001 2023-02-16 14:00:49,134 DEBUG [RS:1;jenkins-hbase20:44247] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,134 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:00:49,134 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44247,1676556047785' 2023-02-16 14:00:49,134 DEBUG [RS:0;jenkins-hbase20:33377] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,134 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:49,134 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33377,1676556047740' 2023-02-16 14:00:49,135 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:49,135 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:49,135 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:49,135 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:00:49,136 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:00:49,136 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:00:49,136 DEBUG [RS:0;jenkins-hbase20:33377] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:49,136 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:00:49,136 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33377,1676556047740' 2023-02-16 14:00:49,136 DEBUG [RS:1;jenkins-hbase20:44247] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,136 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:49,136 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44247,1676556047785' 2023-02-16 14:00:49,136 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:49,137 DEBUG [RS:0;jenkins-hbase20:33377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:49,137 DEBUG [RS:1;jenkins-hbase20:44247] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:49,137 DEBUG [RS:0;jenkins-hbase20:33377] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:00:49,137 DEBUG [RS:1;jenkins-hbase20:44247] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:00:49,137 INFO [RS:0;jenkins-hbase20:33377] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:00:49,137 INFO [RS:1;jenkins-hbase20:44247] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:00:49,137 INFO [RS:0;jenkins-hbase20:33377] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:00:49,137 INFO [RS:1;jenkins-hbase20:44247] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:00:49,218 DEBUG [jenkins-hbase20:46779] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:00:49,222 DEBUG [jenkins-hbase20:46779] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:00:49,227 DEBUG [jenkins-hbase20:46779] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:00:49,227 DEBUG [jenkins-hbase20:46779] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:00:49,228 DEBUG [jenkins-hbase20:46779] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:00:49,230 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44247,1676556047785, state=OPENING 2023-02-16 14:00:49,236 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:00:49,238 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:49,238 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:00:49,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:49,422 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:49,425 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:00:49,428 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35066, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:00:49,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:00:49,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:00:49,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44247%2C1676556047785.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,44247,1676556047785, archiveDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs, maxLogs=32 2023-02-16 14:00:49,473 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK] 2023-02-16 14:00:49,474 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK] 2023-02-16 14:00:49,483 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,44247,1676556047785/jenkins-hbase20.apache.org%2C44247%2C1676556047785.meta.1676556049448.meta 2023-02-16 14:00:49,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK]] 2023-02-16 14:00:49,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:00:49,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:00:49,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:00:49,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:00:49,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:00:49,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:49,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:00:49,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:00:49,516 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:00:49,518 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/info 2023-02-16 14:00:49,518 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/info 2023-02-16 14:00:49,519 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:00:49,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:00:49,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:00:49,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:00:49,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:00:49,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:00:49,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/table 2023-02-16 14:00:49,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/table 2023-02-16 14:00:49,525 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:00:49,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:49,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740 2023-02-16 14:00:49,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740 2023-02-16 14:00:49,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:00:49,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:00:49,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69744835, jitterRate=0.0392790287733078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:00:49,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:00:49,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556049415 2023-02-16 14:00:49,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:00:49,567 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:00:49,568 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44247,1676556047785, state=OPEN 2023-02-16 14:00:49,570 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:00:49,570 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:00:49,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:00:49,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44247,1676556047785 in 328 msec 2023-02-16 14:00:49,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:00:49,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 524 msec 2023-02-16 14:00:49,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 782 msec 2023-02-16 14:00:49,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556049585, completionTime=-1 2023-02-16 14:00:49,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:00:49,586 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:00:49,644 DEBUG [hconnection-0x698c998-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:00:49,647 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:00:49,663 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:00:49,663 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556109663 2023-02-16 14:00:49,663 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556169663 2023-02-16 14:00:49,663 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 76 msec 2023-02-16 14:00:49,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46779,1676556046719-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46779,1676556046719-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46779,1676556046719-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:46779, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:00:49,698 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:00:49,710 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:00:49,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:00:49,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:00:49,727 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:00:49,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:00:49,755 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/hbase/namespace/829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:49,757 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/hbase/namespace/829710608b5ef79ea7673beab4585f84 empty. 2023-02-16 14:00:49,758 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/hbase/namespace/829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:49,758 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:00:49,793 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:00:49,795 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 829710608b5ef79ea7673beab4585f84, NAME => 'hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 829710608b5ef79ea7673beab4585f84, disabling compactions & flushes 2023-02-16 14:00:49,815 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. after waiting 0 ms 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:49,815 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:49,815 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 829710608b5ef79ea7673beab4585f84: 2023-02-16 14:00:49,821 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:00:49,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556049824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556049824"}]},"ts":"1676556049824"} 2023-02-16 14:00:49,861 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:00:49,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:00:49,867 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556049863"}]},"ts":"1676556049863"} 2023-02-16 14:00:49,871 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:00:49,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:00:49,876 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:00:49,876 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:00:49,876 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:00:49,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=829710608b5ef79ea7673beab4585f84, ASSIGN}] 2023-02-16 14:00:49,883 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=829710608b5ef79ea7673beab4585f84, ASSIGN 2023-02-16 14:00:49,885 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=829710608b5ef79ea7673beab4585f84, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:50,037 INFO [jenkins-hbase20:46779] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:00:50,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=829710608b5ef79ea7673beab4585f84, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:50,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556050038"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556050038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556050038"}]},"ts":"1676556050038"} 2023-02-16 14:00:50,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 829710608b5ef79ea7673beab4585f84, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:50,147 INFO [RS:0;jenkins-hbase20:33377] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33377%2C1676556047740, suffix=, logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,33377,1676556047740, archiveDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs, maxLogs=32 2023-02-16 14:00:50,147 INFO [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44247%2C1676556047785, suffix=, logDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,44247,1676556047785, archiveDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs, maxLogs=32 2023-02-16 14:00:50,165 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK] 2023-02-16 14:00:50,165 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK] 2023-02-16 14:00:50,170 INFO [RS:0;jenkins-hbase20:33377] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,33377,1676556047740/jenkins-hbase20.apache.org%2C33377%2C1676556047740.1676556050148 2023-02-16 14:00:50,172 DEBUG [RS:0;jenkins-hbase20:33377] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK]] 2023-02-16 14:00:50,172 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK] 2023-02-16 14:00:50,172 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK] 2023-02-16 14:00:50,181 INFO [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/WALs/jenkins-hbase20.apache.org,44247,1676556047785/jenkins-hbase20.apache.org%2C44247%2C1676556047785.1676556050149 2023-02-16 14:00:50,181 DEBUG [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35821,DS-d97a700d-20b8-46a5-a552-d94f5a859953,DISK], DatanodeInfoWithStorage[127.0.0.1:42325,DS-c7a15f7e-a9cd-453d-8037-7738379ebeed,DISK]] 2023-02-16 14:00:50,204 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:50,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 829710608b5ef79ea7673beab4585f84, NAME => 'hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:00:50,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,208 INFO [StoreOpener-829710608b5ef79ea7673beab4585f84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,210 DEBUG [StoreOpener-829710608b5ef79ea7673beab4585f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/info 2023-02-16 14:00:50,210 DEBUG [StoreOpener-829710608b5ef79ea7673beab4585f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/info 2023-02-16 14:00:50,210 INFO [StoreOpener-829710608b5ef79ea7673beab4585f84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 829710608b5ef79ea7673beab4585f84 columnFamilyName info 2023-02-16 14:00:50,211 INFO [StoreOpener-829710608b5ef79ea7673beab4585f84-1] regionserver.HStore(310): Store=829710608b5ef79ea7673beab4585f84/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:50,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 829710608b5ef79ea7673beab4585f84 2023-02-16 14:00:50,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:50,225 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 829710608b5ef79ea7673beab4585f84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70918752, jitterRate=0.05677175521850586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:00:50,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 829710608b5ef79ea7673beab4585f84: 2023-02-16 14:00:50,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84., pid=6, masterSystemTime=1676556050199 2023-02-16 14:00:50,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:50,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:00:50,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=829710608b5ef79ea7673beab4585f84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:50,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556050234"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556050234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556050234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556050234"}]},"ts":"1676556050234"} 2023-02-16 14:00:50,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:00:50,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 829710608b5ef79ea7673beab4585f84, server=jenkins-hbase20.apache.org,44247,1676556047785 in 195 msec 2023-02-16 14:00:50,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:00:50,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=829710608b5ef79ea7673beab4585f84, ASSIGN in 364 msec 2023-02-16 14:00:50,248 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:00:50,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556050248"}]},"ts":"1676556050248"} 2023-02-16 14:00:50,252 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:00:50,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:00:50,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 542 msec 2023-02-16 14:00:50,327 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:00:50,328 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:00:50,328 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:00:50,360 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:00:50,384 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:00:50,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-02-16 14:00:50,395 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:00:50,409 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:00:50,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-16 14:00:50,428 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:00:50,430 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:00:50,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.575sec 2023-02-16 14:00:50,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:00:50,434 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:00:50,434 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:00:50,436 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46779,1676556046719-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:00:50,437 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46779,1676556046719-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:00:50,445 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:00:50,519 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ReadOnlyZKClient(139): Connect 0x54e921cf to 127.0.0.1:49697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:00:50,523 DEBUG [Listener at localhost.localdomain/44383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b90e607, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:00:50,590 DEBUG [hconnection-0x75fe36bf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:00:50,602 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:00:50,611 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:00:50,611 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:00:50,619 DEBUG [Listener at localhost.localdomain/44383] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:00:50,622 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:00:50,627 INFO [Listener at localhost.localdomain/44383] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 14:00:50,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-16 14:00:50,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:00:50,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 148.251.75.209:40616 deadline: 1676556110630, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 14:00:50,646 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 14:00:50,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:00:50,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 14:00:50,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:00:50,667 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:00:50,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 14:00:50,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:50,694 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:50,695 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:50,695 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:00:50,695 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:50,695 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:50,696 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb empty. 2023-02-16 14:00:50,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 empty. 2023-02-16 14:00:50,696 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 empty. 2023-02-16 14:00:50,696 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 empty. 2023-02-16 14:00:50,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f empty. 2023-02-16 14:00:50,697 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 empty. 2023-02-16 14:00:50,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 empty. 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a empty. 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e empty. 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 empty. 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:00:50,699 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:50,699 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 14:00:50,720 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 14:00:50,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b24da50fa4c6b14f2f6f513e9bf504fb, NAME => 'testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,723 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7e031fb58194bee0abae88182b415201, NAME => 'testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,723 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c1fb0fe4f45a06f8cd3defe169ecc92f, NAME => 'testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,765 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,765 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c1fb0fe4f45a06f8cd3defe169ecc92f, disabling compactions & flushes 2023-02-16 14:00:50,765 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:50,765 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:50,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. after waiting 0 ms 2023-02-16 14:00:50,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:50,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:50,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:50,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 388f42865c01c412d90447f9567ff8c0, NAME => 'testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,768 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,768 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7e031fb58194bee0abae88182b415201, disabling compactions & flushes 2023-02-16 14:00:50,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b24da50fa4c6b14f2f6f513e9bf504fb, disabling compactions & flushes 2023-02-16 14:00:50,769 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:50,769 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. after waiting 0 ms 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. after waiting 0 ms 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:50,770 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:50,770 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:50,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:50,771 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f8a0a3736f9c989dc61ebaab04927581, NAME => 'testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,771 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d8895fbba69fa76f6c0520e57c58dab2, NAME => 'testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:50,802 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,804 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 388f42865c01c412d90447f9567ff8c0, disabling compactions & flushes 2023-02-16 14:00:50,804 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:50,804 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:50,805 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. after waiting 0 ms 2023-02-16 14:00:50,805 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:50,805 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:50,805 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:50,807 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, NAME => 'testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,808 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,809 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d8895fbba69fa76f6c0520e57c58dab2, disabling compactions & flushes 2023-02-16 14:00:50,809 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:50,809 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:50,809 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. after waiting 0 ms 2023-02-16 14:00:50,809 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:50,810 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:50,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:50,810 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0604aa4f347536d904962429f66f960e, NAME => 'testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,830 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, disabling compactions & flushes 2023-02-16 14:00:50,831 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:50,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:50,832 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. after waiting 0 ms 2023-02-16 14:00:50,832 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:50,832 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:50,832 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:50,833 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bd3c5bcd9c5ff5a8c5bf643baa21c4b5, NAME => 'testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,834 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0604aa4f347536d904962429f66f960e, disabling compactions & flushes 2023-02-16 14:00:50,835 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:50,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:50,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. after waiting 0 ms 2023-02-16 14:00:50,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:50,835 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:50,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:50,836 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d63ab4d25a0c157a63af30f559a14f1a, NAME => 'testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp 2023-02-16 14:00:50,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:50,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d63ab4d25a0c157a63af30f559a14f1a, disabling compactions & flushes 2023-02-16 14:00:50,858 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:50,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:50,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. after waiting 0 ms 2023-02-16 14:00:50,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:50,859 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:50,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:50,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f8a0a3736f9c989dc61ebaab04927581, disabling compactions & flushes 2023-02-16 14:00:51,211 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. after waiting 0 ms 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,211 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,211 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bd3c5bcd9c5ff5a8c5bf643baa21c4b5, disabling compactions & flushes 2023-02-16 14:00:51,261 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. after waiting 0 ms 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,261 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:51,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556051268"}]},"ts":"1676556051268"} 2023-02-16 14:00:51,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:51,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 14:00:51,315 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:00:51,315 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556051315"}]},"ts":"1676556051315"} 2023-02-16 14:00:51,317 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 14:00:51,321 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:00:51,332 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:00:51,332 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:00:51,332 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:00:51,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, ASSIGN}] 2023-02-16 14:00:51,336 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, ASSIGN 2023-02-16 14:00:51,337 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, ASSIGN 2023-02-16 14:00:51,337 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, ASSIGN 2023-02-16 14:00:51,337 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, ASSIGN 2023-02-16 14:00:51,339 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:51,339 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33377,1676556047740; forceNewPlan=false, retain=false 2023-02-16 14:00:51,339 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, ASSIGN 2023-02-16 14:00:51,339 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33377,1676556047740; forceNewPlan=false, retain=false 2023-02-16 14:00:51,339 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:51,341 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, ASSIGN 2023-02-16 14:00:51,341 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33377,1676556047740; forceNewPlan=false, retain=false 2023-02-16 14:00:51,341 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, ASSIGN 2023-02-16 14:00:51,341 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, ASSIGN 2023-02-16 14:00:51,341 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, ASSIGN 2023-02-16 14:00:51,342 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, ASSIGN 2023-02-16 14:00:51,342 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33377,1676556047740; forceNewPlan=false, retain=false 2023-02-16 14:00:51,342 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:51,342 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:51,342 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33377,1676556047740; forceNewPlan=false, retain=false 2023-02-16 14:00:51,344 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44247,1676556047785; forceNewPlan=false, retain=false 2023-02-16 14:00:51,489 INFO [jenkins-hbase20:46779] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 14:00:51,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7e031fb58194bee0abae88182b415201, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c1fb0fe4f45a06f8cd3defe169ecc92f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051493"}]},"ts":"1676556051493"} 2023-02-16 14:00:51,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051493"}]},"ts":"1676556051493"} 2023-02-16 14:00:51,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0604aa4f347536d904962429f66f960e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d8895fbba69fa76f6c0520e57c58dab2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f8a0a3736f9c989dc61ebaab04927581, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051493"}]},"ts":"1676556051493"} 2023-02-16 14:00:51,494 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051493"}]},"ts":"1676556051493"} 2023-02-16 14:00:51,494 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051493"}]},"ts":"1676556051493"} 2023-02-16 14:00:51,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure 7e031fb58194bee0abae88182b415201, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:51,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure c1fb0fe4f45a06f8cd3defe169ecc92f, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:51,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure 0604aa4f347536d904962429f66f960e, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:51,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure f8a0a3736f9c989dc61ebaab04927581, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:51,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure d8895fbba69fa76f6c0520e57c58dab2, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:51,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051514"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051514"}]},"ts":"1676556051514"} 2023-02-16 14:00:51,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure bd3c5bcd9c5ff5a8c5bf643baa21c4b5, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:51,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,547 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051543"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051543"}]},"ts":"1676556051543"} 2023-02-16 14:00:51,548 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d63ab4d25a0c157a63af30f559a14f1a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051548"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051548"}]},"ts":"1676556051548"} 2023-02-16 14:00:51,549 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b24da50fa4c6b14f2f6f513e9bf504fb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,549 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=388f42865c01c412d90447f9567ff8c0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,549 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051549"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051549"}]},"ts":"1676556051549"} 2023-02-16 14:00:51,549 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051549"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556051549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556051549"}]},"ts":"1676556051549"} 2023-02-16 14:00:51,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:51,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure d63ab4d25a0c157a63af30f559a14f1a, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:51,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure b24da50fa4c6b14f2f6f513e9bf504fb, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:51,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 388f42865c01c412d90447f9567ff8c0, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:51,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:51,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c1fb0fe4f45a06f8cd3defe169ecc92f, NAME => 'testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 14:00:51,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,664 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,666 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1 2023-02-16 14:00:51,666 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1 2023-02-16 14:00:51,666 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1fb0fe4f45a06f8cd3defe169ecc92f columnFamilyName f1 2023-02-16 14:00:51,667 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(310): Store=c1fb0fe4f45a06f8cd3defe169ecc92f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,667 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,669 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2 2023-02-16 14:00:51,669 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2 2023-02-16 14:00:51,670 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1fb0fe4f45a06f8cd3defe169ecc92f columnFamilyName f2 2023-02-16 14:00:51,671 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(310): Store=c1fb0fe4f45a06f8cd3defe169ecc92f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened c1fb0fe4f45a06f8cd3defe169ecc92f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68360089, jitterRate=0.018644705414772034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:51,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f., pid=22, masterSystemTime=1676556051655 2023-02-16 14:00:51,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:51,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:51,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:51,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d8895fbba69fa76f6c0520e57c58dab2, NAME => 'testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 14:00:51,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c1fb0fe4f45a06f8cd3defe169ecc92f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051688"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051688"}]},"ts":"1676556051688"} 2023-02-16 14:00:51,690 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,692 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1 2023-02-16 14:00:51,692 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1 2023-02-16 14:00:51,693 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8895fbba69fa76f6c0520e57c58dab2 columnFamilyName f1 2023-02-16 14:00:51,694 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(310): Store=d8895fbba69fa76f6c0520e57c58dab2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,694 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-16 14:00:51,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure c1fb0fe4f45a06f8cd3defe169ecc92f, server=jenkins-hbase20.apache.org,44247,1676556047785 in 191 msec 2023-02-16 14:00:51,696 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2 2023-02-16 14:00:51,697 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2 2023-02-16 14:00:51,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, ASSIGN in 363 msec 2023-02-16 14:00:51,697 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8895fbba69fa76f6c0520e57c58dab2 columnFamilyName f2 2023-02-16 14:00:51,698 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(310): Store=d8895fbba69fa76f6c0520e57c58dab2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,700 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,701 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:00:51,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:00:51,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:51,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:51,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b24da50fa4c6b14f2f6f513e9bf504fb, NAME => 'testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 14:00:51,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d8895fbba69fa76f6c0520e57c58dab2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65340324, jitterRate=-0.026353299617767334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:51,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2., pid=25, masterSystemTime=1676556051655 2023-02-16 14:00:51,720 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,723 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f1 2023-02-16 14:00:51,723 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f1 2023-02-16 14:00:51,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:51,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:51,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8a0a3736f9c989dc61ebaab04927581, NAME => 'testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 14:00:51,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d8895fbba69fa76f6c0520e57c58dab2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,724 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24da50fa4c6b14f2f6f513e9bf504fb columnFamilyName f1 2023-02-16 14:00:51,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051723"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051723"}]},"ts":"1676556051723"} 2023-02-16 14:00:51,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,725 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(310): Store=b24da50fa4c6b14f2f6f513e9bf504fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,726 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,727 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,728 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f2 2023-02-16 14:00:51,728 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f2 2023-02-16 14:00:51,729 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24da50fa4c6b14f2f6f513e9bf504fb columnFamilyName f2 2023-02-16 14:00:51,729 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1 2023-02-16 14:00:51,730 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1 2023-02-16 14:00:51,730 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(310): Store=b24da50fa4c6b14f2f6f513e9bf504fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,732 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a0a3736f9c989dc61ebaab04927581 columnFamilyName f1 2023-02-16 14:00:51,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,733 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(310): Store=f8a0a3736f9c989dc61ebaab04927581/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,734 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,736 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2 2023-02-16 14:00:51,737 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2 2023-02-16 14:00:51,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-16 14:00:51,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure d8895fbba69fa76f6c0520e57c58dab2, server=jenkins-hbase20.apache.org,44247,1676556047785 in 223 msec 2023-02-16 14:00:51,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, ASSIGN in 406 msec 2023-02-16 14:00:51,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:51,748 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a0a3736f9c989dc61ebaab04927581 columnFamilyName f2 2023-02-16 14:00:51,751 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(310): Store=f8a0a3736f9c989dc61ebaab04927581/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b24da50fa4c6b14f2f6f513e9bf504fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74802242, jitterRate=0.1146402657032013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:51,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb., pid=29, masterSystemTime=1676556051700 2023-02-16 14:00:51,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:51,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b24da50fa4c6b14f2f6f513e9bf504fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051764"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051764"}]},"ts":"1676556051764"} 2023-02-16 14:00:51,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:51,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:51,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d63ab4d25a0c157a63af30f559a14f1a, NAME => 'testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 14:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,768 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-16 14:00:51,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure b24da50fa4c6b14f2f6f513e9bf504fb, server=jenkins-hbase20.apache.org,33377,1676556047740 in 214 msec 2023-02-16 14:00:51,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f8a0a3736f9c989dc61ebaab04927581; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72558012, jitterRate=0.08119863271713257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,772 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f1 2023-02-16 14:00:51,772 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f1 2023-02-16 14:00:51,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:51,773 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d63ab4d25a0c157a63af30f559a14f1a columnFamilyName f1 2023-02-16 14:00:51,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581., pid=24, masterSystemTime=1676556051655 2023-02-16 14:00:51,774 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(310): Store=d63ab4d25a0c157a63af30f559a14f1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,774 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, ASSIGN in 439 msec 2023-02-16 14:00:51,777 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f2 2023-02-16 14:00:51,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,777 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f2 2023-02-16 14:00:51,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:51,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:51,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0604aa4f347536d904962429f66f960e, NAME => 'testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 14:00:51,777 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d63ab4d25a0c157a63af30f559a14f1a columnFamilyName f2 2023-02-16 14:00:51,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,778 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(310): Store=d63ab4d25a0c157a63af30f559a14f1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,779 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f8a0a3736f9c989dc61ebaab04927581, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051778"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051778"}]},"ts":"1676556051778"} 2023-02-16 14:00:51,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,785 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,789 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1 2023-02-16 14:00:51,789 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1 2023-02-16 14:00:51,790 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0604aa4f347536d904962429f66f960e columnFamilyName f1 2023-02-16 14:00:51,791 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(310): Store=0604aa4f347536d904962429f66f960e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,791 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:51,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-16 14:00:51,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure f8a0a3736f9c989dc61ebaab04927581, server=jenkins-hbase20.apache.org,44247,1676556047785 in 284 msec 2023-02-16 14:00:51,794 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2 2023-02-16 14:00:51,794 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2 2023-02-16 14:00:51,794 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0604aa4f347536d904962429f66f960e columnFamilyName f2 2023-02-16 14:00:51,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, ASSIGN in 460 msec 2023-02-16 14:00:51,795 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(310): Store=0604aa4f347536d904962429f66f960e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d63ab4d25a0c157a63af30f559a14f1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73765777, jitterRate=0.09919573366641998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:51,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:51,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a., pid=28, masterSystemTime=1676556051700 2023-02-16 14:00:51,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:51,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:51,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bd3c5bcd9c5ff5a8c5bf643baa21c4b5, NAME => 'testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 14:00:51,803 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d63ab4d25a0c157a63af30f559a14f1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,804 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556051803"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051803"}]},"ts":"1676556051803"} 2023-02-16 14:00:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,807 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:51,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-16 14:00:51,812 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1 2023-02-16 14:00:51,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure d63ab4d25a0c157a63af30f559a14f1a, server=jenkins-hbase20.apache.org,33377,1676556047740 in 256 msec 2023-02-16 14:00:51,813 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1 2023-02-16 14:00:51,815 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 columnFamilyName f1 2023-02-16 14:00:51,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, ASSIGN in 481 msec 2023-02-16 14:00:51,816 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(310): Store=bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,816 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,819 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2 2023-02-16 14:00:51,819 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2 2023-02-16 14:00:51,819 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 columnFamilyName f2 2023-02-16 14:00:51,820 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(310): Store=bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0604aa4f347536d904962429f66f960e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64934769, jitterRate=-0.03239654004573822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:51,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e., pid=23, masterSystemTime=1676556051655 2023-02-16 14:00:51,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:51,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:51,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:51,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e031fb58194bee0abae88182b415201, NAME => 'testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 14:00:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0604aa4f347536d904962429f66f960e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051829"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051829"}]},"ts":"1676556051829"} 2023-02-16 14:00:51,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:51,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-16 14:00:51,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure 0604aa4f347536d904962429f66f960e, server=jenkins-hbase20.apache.org,44247,1676556047785 in 329 msec 2023-02-16 14:00:51,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, ASSIGN in 504 msec 2023-02-16 14:00:51,839 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bd3c5bcd9c5ff5a8c5bf643baa21c4b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67381709, jitterRate=0.004065707325935364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:51,841 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1 2023-02-16 14:00:51,841 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1 2023-02-16 14:00:51,842 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e031fb58194bee0abae88182b415201 columnFamilyName f1 2023-02-16 14:00:51,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5., pid=26, masterSystemTime=1676556051700 2023-02-16 14:00:51,843 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(310): Store=7e031fb58194bee0abae88182b415201/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,843 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:51,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:51,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 388f42865c01c412d90447f9567ff8c0, NAME => 'testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 14:00:51,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051847"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051847"}]},"ts":"1676556051847"} 2023-02-16 14:00:51,849 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2 2023-02-16 14:00:51,849 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2 2023-02-16 14:00:51,850 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e031fb58194bee0abae88182b415201 columnFamilyName f2 2023-02-16 14:00:51,851 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(310): Store=7e031fb58194bee0abae88182b415201/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-16 14:00:51,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure bd3c5bcd9c5ff5a8c5bf643baa21c4b5, server=jenkins-hbase20.apache.org,33377,1676556047740 in 308 msec 2023-02-16 14:00:51,855 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, ASSIGN in 522 msec 2023-02-16 14:00:51,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,858 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1 2023-02-16 14:00:51,858 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1 2023-02-16 14:00:51,859 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 388f42865c01c412d90447f9567ff8c0 columnFamilyName f1 2023-02-16 14:00:51,860 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(310): Store=388f42865c01c412d90447f9567ff8c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,860 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,862 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2 2023-02-16 14:00:51,862 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2 2023-02-16 14:00:51,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:51,863 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 388f42865c01c412d90447f9567ff8c0 columnFamilyName f2 2023-02-16 14:00:51,863 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(310): Store=388f42865c01c412d90447f9567ff8c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7e031fb58194bee0abae88182b415201; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73584807, jitterRate=0.09649907052516937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:51,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201., pid=21, masterSystemTime=1676556051655 2023-02-16 14:00:51,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:51,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:51,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:51,871 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7e031fb58194bee0abae88182b415201, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:51,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051870"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051870"}]},"ts":"1676556051870"} 2023-02-16 14:00:51,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 388f42865c01c412d90447f9567ff8c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61643668, jitterRate=-0.08143776655197144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:51,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0., pid=30, masterSystemTime=1676556051700 2023-02-16 14:00:51,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-16 14:00:51,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure 7e031fb58194bee0abae88182b415201, server=jenkins-hbase20.apache.org,44247,1676556047785 in 375 msec 2023-02-16 14:00:51,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:51,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:51,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:51,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, NAME => 'testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 14:00:51,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, ASSIGN in 545 msec 2023-02-16 14:00:51,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=388f42865c01c412d90447f9567ff8c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,880 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051879"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051879"}]},"ts":"1676556051879"} 2023-02-16 14:00:51,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:51,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,882 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,885 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1 2023-02-16 14:00:51,885 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1 2023-02-16 14:00:51,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-16 14:00:51,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 388f42865c01c412d90447f9567ff8c0, server=jenkins-hbase20.apache.org,33377,1676556047740 in 328 msec 2023-02-16 14:00:51,885 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 columnFamilyName f1 2023-02-16 14:00:51,886 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(310): Store=55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,886 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, ASSIGN in 553 msec 2023-02-16 14:00:51,888 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2 2023-02-16 14:00:51,889 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2 2023-02-16 14:00:51,889 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 columnFamilyName f2 2023-02-16 14:00:51,890 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(310): Store=55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:51,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:51,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:51,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:00:51,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 55ebb672fa8bd1bfc8ba62e9f2d5e7b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65858314, jitterRate=-0.018634647130966187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:51,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:51,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5., pid=27, masterSystemTime=1676556051700 2023-02-16 14:00:51,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:51,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:51,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:51,902 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556051902"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556051902"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556051902"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556051902"}]},"ts":"1676556051902"} 2023-02-16 14:00:51,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-16 14:00:51,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, server=jenkins-hbase20.apache.org,33377,1676556047740 in 354 msec 2023-02-16 14:00:51,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-16 14:00:51,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, ASSIGN in 575 msec 2023-02-16 14:00:51,911 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:00:51,912 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556051912"}]},"ts":"1676556051912"} 2023-02-16 14:00:51,914 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 14:00:51,917 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:00:51,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2580 sec 2023-02-16 14:00:52,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:00:52,802 INFO [Listener at localhost.localdomain/44383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 14:00:52,802 DEBUG [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 14:00:52,804 INFO [Listener at localhost.localdomain/44383] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:00:52,812 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 14:00:52,812 INFO [Listener at localhost.localdomain/44383] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:00:52,813 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 14:00:52,813 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:00:52,970 DEBUG [hconnection-0x75fe36bf-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:00:53,007 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:00:53,035 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33377] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:53,040 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44247] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:53,302 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:00:53,304 INFO [Listener at localhost.localdomain/44383] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:00:53,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:00:53,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556053315 (current time:1676556053315). 2023-02-16 14:00:53,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:00:53,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa5417f to 127.0.0.1:49697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:00:53,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1285da42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:00:53,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:00:53,329 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:00:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa5417f to 127.0.0.1:49697 2023-02-16 14:00:53,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:00:53,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:00:53,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:00:53,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:00:53,355 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:00:53,356 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676556653356 2023-02-16 14:00:53,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:00:53,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 14:00:53,360 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:00:53,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:00:53,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 14 msec 2023-02-16 14:00:53,363 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:00:53,364 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:00:53,364 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:00:53,364 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676556653364 2023-02-16 14:00:53,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-16 14:00:53,393 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-16 14:00:53,393 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:00:53,393 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-16 14:00:53,394 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 14:00:53,394 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:53,394 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:53,395 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:00:53,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:00:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:53,396 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,396 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,396 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,396 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:00:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:53,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:00:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:53,397 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:53,397 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:00:53,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 14:00:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:53,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 14:00:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 14:00:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:53,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 14:00:53,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 14:00:53,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 14:00:53,400 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 14:00:53,400 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 14:00:53,400 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:00:53,400 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33377,1676556047740' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 14:00:53,401 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44247,1676556047785' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 14:00:53,411 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,411 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:53,411 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:00:53,411 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,411 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,412 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:00:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:53,412 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,412 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:00:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:53,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44247,1676556047785' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 14:00:53,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b915cc[Count = 1] remaining members to acquire global barrier 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:53,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33377,1676556047740' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 14:00:53,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b915cc[Count = 0] remaining members to acquire global barrier 2023-02-16 14:00:53,416 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 14:00:53,416 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,427 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,428 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:00:53,429 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:53,430 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:00:53,431 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:53,431 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. started... 2023-02-16 14:00:53,439 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:53,439 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:53,439 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:00:53,441 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:53,441 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. started... 2023-02-16 14:00:53,447 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:53,449 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:53,452 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,448 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:00:53,451 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:00:53,455 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:00:53,455 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:53,455 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. started... 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. started... 2023-02-16 14:00:53,456 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c1fb0fe4f45a06f8cd3defe169ecc92f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. started... 2023-02-16 14:00:53,458 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,451 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. started... 2023-02-16 14:00:53,451 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:00:53,464 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:00:53,465 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:00:53,465 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:00:53,467 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d8895fbba69fa76f6c0520e57c58dab2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:53,469 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7e031fb58194bee0abae88182b415201 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:53,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:00:53,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:00:53,473 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:00:53,479 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 388f42865c01c412d90447f9567ff8c0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:53,532 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. completed. 2023-02-16 14:00:53,532 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:53,533 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:53,533 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:00:53,533 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. started... 2023-02-16 14:00:53,533 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:53,674 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:00:53,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:00:53,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:00:53,679 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 14:00:53,696 WARN [DataStreamer for file /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f1/502282555f9e425fab62f943db1cac31] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-16 14:00:53,700 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f1/2d1a4c33481e40579899036625914300 2023-02-16 14:00:53,701 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f1/502282555f9e425fab62f943db1cac31 2023-02-16 14:00:53,704 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f1/7c523bc64fda4cf5b87b19d34f21fd76 2023-02-16 14:00:53,706 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f1/b9ea6a182fe54c60a87a8eae19be57b2 2023-02-16 14:00:53,811 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f2/1947036add07493097d5f9e167b09b0a 2023-02-16 14:00:53,821 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f1/7c523bc64fda4cf5b87b19d34f21fd76 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76 2023-02-16 14:00:53,827 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f2/6faea62648774763a1f6dd6d51e0944b 2023-02-16 14:00:53,838 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f2/75b1ef25fada47b5826148b9071e3bb0 2023-02-16 14:00:53,841 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f1/2d1a4c33481e40579899036625914300 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300 2023-02-16 14:00:53,844 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:00:53,847 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f2/19c8868cb44245a785e65fe11c1168ba 2023-02-16 14:00:53,850 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f2/1947036add07493097d5f9e167b09b0a as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a 2023-02-16 14:00:53,850 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f1/502282555f9e425fab62f943db1cac31 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31 2023-02-16 14:00:53,857 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:53,862 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f1/b9ea6a182fe54c60a87a8eae19be57b2 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2 2023-02-16 14:00:53,864 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:53,865 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f2/6faea62648774763a1f6dd6d51e0944b as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b 2023-02-16 14:00:53,867 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f2/75b1ef25fada47b5826148b9071e3bb0 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0 2023-02-16 14:00:53,881 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:00:53,881 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:53,883 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c1fb0fe4f45a06f8cd3defe169ecc92f in 426ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:53,885 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 14:00:53,885 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:00:53,886 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f2/19c8868cb44245a785e65fe11c1168ba as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba 2023-02-16 14:00:53,883 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 388f42865c01c412d90447f9567ff8c0 in 409ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:53,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:53,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76] hfiles 2023-02-16 14:00:53,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,890 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:53,891 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,891 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,891 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300] hfiles 2023-02-16 14:00:53,891 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,892 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a] hfiles 2023-02-16 14:00:53,892 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b] hfiles 2023-02-16 14:00:53,892 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,892 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,895 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:53,897 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d8895fbba69fa76f6c0520e57c58dab2 in 430ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,897 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31] hfiles 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,897 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0] hfiles 2023-02-16 14:00:53,898 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,898 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for bd3c5bcd9c5ff5a8c5bf643baa21c4b5 in 450ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2] hfiles 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba] hfiles 2023-02-16 14:00:53,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. completed. 2023-02-16 14:00:53,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:53,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:53,922 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:00:53,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. started... 2023-02-16 14:00:53,923 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:53,923 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:53,923 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:53,923 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:00:53,924 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:00:53,924 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. completed. 2023-02-16 14:00:53,924 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:53,924 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:00:53,926 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. completed. 2023-02-16 14:00:53,927 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:53,927 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:00:53,927 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:53,927 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. started... 2023-02-16 14:00:53,928 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0604aa4f347536d904962429f66f960e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:53,934 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. completed. 2023-02-16 14:00:53,934 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:53,934 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:00:53,952 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f1/efd314fa701e40e6a04b2ea3f39f3864 2023-02-16 14:00:53,980 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:00:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:00:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:00:53,982 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 14:00:53,983 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f2/806056b3737a4406bd536a11775c7017 2023-02-16 14:00:53,992 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f1/efd314fa701e40e6a04b2ea3f39f3864 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864 2023-02-16 14:00:54,004 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,005 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f2/806056b3737a4406bd536a11775c7017 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017 2023-02-16 14:00:54,017 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,018 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0604aa4f347536d904962429f66f960e in 91ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864] hfiles 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,019 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017] hfiles 2023-02-16 14:00:54,020 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,034 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. completed. 2023-02-16 14:00:54,034 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:54,034 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:54,034 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:00:54,034 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. started... 2023-02-16 14:00:54,035 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f8a0a3736f9c989dc61ebaab04927581 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:00:54,055 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f1/ba20f4a0120047d291248e25b61cceb7 2023-02-16 14:00:54,078 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f2/e0f3fca993d04d049cce7fac708a3cff 2023-02-16 14:00:54,081 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f1/f286a6117bbf4db9bfadf48259254e41 2023-02-16 14:00:54,085 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f1/8eb4c90f3fc44dee8a449a590b85b601 2023-02-16 14:00:54,089 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f1/ba20f4a0120047d291248e25b61cceb7 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7 2023-02-16 14:00:54,100 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,103 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f2/e0f3fca993d04d049cce7fac708a3cff as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff 2023-02-16 14:00:54,110 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,111 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8a0a3736f9c989dc61ebaab04927581 in 76ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:54,111 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7] hfiles 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff] hfiles 2023-02-16 14:00:54,112 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,131 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f2/e3e7cb16563345409427fba4bac597ad 2023-02-16 14:00:54,139 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. completed. 2023-02-16 14:00:54,139 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:54,139 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:00:54,141 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f1/f286a6117bbf4db9bfadf48259254e41 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41 2023-02-16 14:00:54,150 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,152 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f2/e3e7cb16563345409427fba4bac597ad as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad 2023-02-16 14:00:54,161 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,162 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7e031fb58194bee0abae88182b415201 in 693ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41] hfiles 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad] hfiles 2023-02-16 14:00:54,163 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,174 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. completed. 2023-02-16 14:00:54,174 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:54,174 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:00:54,323 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. completed. 2023-02-16 14:00:54,323 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:54,323 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:00:54,323 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:00:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 14:00:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,44247,1676556047785' in zk 2023-02-16 14:00:54,326 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:00:54,326 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,326 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:00:54,326 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 14:00:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,44247,1676556047785': 2023-02-16 14:00:54,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44247,1676556047785' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 14:00:54,482 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:00:54,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:00:54,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:00:54,485 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 14:00:54,517 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f2/51e320c7be5c420584041b2fad0dc76c 2023-02-16 14:00:54,541 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f1/8eb4c90f3fc44dee8a449a590b85b601 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601 2023-02-16 14:00:54,550 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,551 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f2/51e320c7be5c420584041b2fad0dc76c as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c 2023-02-16 14:00:54,559 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:00:54,560 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 in 1027ms, sequenceid=5, compaction requested=false 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601] hfiles 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601 for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,560 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c] hfiles 2023-02-16 14:00:54,561 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c for snapshot=testWithMapReduceMultiRegion 2023-02-16 14:00:54,572 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. completed. 2023-02-16 14:00:54,572 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:00:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:00:54,573 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,573 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 14:00:54,573 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,33377,1676556047740' in zk 2023-02-16 14:00:54,817 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:00:54,817 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:54,817 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 14:00:54,817 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:00:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,33377,1676556047740': 2023-02-16 14:00:54,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33377,1676556047740' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 14:00:54,823 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-16 14:00:54,823 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:00:54,823 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:00:54,823 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-16 14:00:54,823 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:00:54,826 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,826 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:00:54,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:54,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:00:54,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:54,827 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,828 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:54,830 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 14:00:54,830 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:00:54,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-16 14:00:54,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:00:54,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:54,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-16 14:00:54,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 14:00:54,840 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:54,840 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:54,840 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:54,840 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 14:00:54,840 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 14:00:54,839 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:54,839 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:00:54,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:00:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:54,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:00:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:00:54,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 14:00:54,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-16 14:00:54,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-16 14:00:54,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 14:00:54,951 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 14:00:54,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676556053357Consolidate snapshot: testWithMapReduceMultiRegion at 1676556054839 (+1482 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676556054840 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676556054869 (+29 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676556054888 (+19 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676556054951 (+63 ms) 2023-02-16 14:00:54,953 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:00:54,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5950 sec 2023-02-16 14:00:55,039 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-16 14:00:55,110 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 14:00:55,111 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 14:00:55,485 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:00:55,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:00:55,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:00:55,487 INFO [Listener at localhost.localdomain/44383] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:00:55,497 INFO [Listener at localhost.localdomain/44383] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:00:55,509 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:00:55,567 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33377] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:55,585 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44247] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:55,711 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:00:55,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:00:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 14:00:55,732 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 14:00:55,732 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:00:55,732 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 14:00:55,732 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 14:00:55,733 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:55,733 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:55,734 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:00:55,734 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:00:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:55,734 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:00:55,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:00:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:55,734 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,735 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:55,735 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:55,735 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:55,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:00:55,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:00:55,737 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:00:55,737 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:00:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:00:55,738 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:00:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:55,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:00:55,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:00:55,739 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:00:55,739 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:00:55,742 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. started... 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. started... 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:55,743 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:00:55,743 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:55,744 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:55,744 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. started... 2023-02-16 14:00:55,744 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 388f42865c01c412d90447f9567ff8c0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:00:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:00:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:00:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:00:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. started... 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. started... 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:55,748 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. started... 2023-02-16 14:00:55,748 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,748 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e031fb58194bee0abae88182b415201 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,747 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:55,748 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. started... 2023-02-16 14:00:55,748 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d8895fbba69fa76f6c0520e57c58dab2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,749 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c1fb0fe4f45a06f8cd3defe169ecc92f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:00:55,798 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f1/220c056bfe304a988010b02d46ca00a6 2023-02-16 14:00:55,821 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f1/98899dd757f14147924be8249ed67449 2023-02-16 14:00:55,821 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f1/86247a28cf8546deb55e8ebb7b3caee0 2023-02-16 14:00:55,824 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f1/a5866b89dbd8403bbbd96745ec8f4351 2023-02-16 14:00:55,825 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f1/27b2f0aee5c0479cae760238cd078d47 2023-02-16 14:00:55,825 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f1/e93b5a5265904c888ea42e498659816b 2023-02-16 14:00:55,867 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f2/1e9e989ac1d3490098cc8deecd75fbe3 2023-02-16 14:00:55,874 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f1/220c056bfe304a988010b02d46ca00a6 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/220c056bfe304a988010b02d46ca00a6 2023-02-16 14:00:55,879 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f2/50651809d6c74f9ab6ee82572ed59532 2023-02-16 14:00:55,883 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f2/aa13550b266d41baa4f34ddf52769ad8 2023-02-16 14:00:55,885 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/220c056bfe304a988010b02d46ca00a6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,886 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f2/e423df28598d4056a9ad3616a0701bc2 2023-02-16 14:00:55,887 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/.tmp/f2/1e9e989ac1d3490098cc8deecd75fbe3 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/1e9e989ac1d3490098cc8deecd75fbe3 2023-02-16 14:00:55,887 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f1/e93b5a5265904c888ea42e498659816b as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/e93b5a5265904c888ea42e498659816b 2023-02-16 14:00:55,888 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f2/767cb631d08642eb959ce08256f04eac 2023-02-16 14:00:55,892 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f1/98899dd757f14147924be8249ed67449 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/98899dd757f14147924be8249ed67449 2023-02-16 14:00:55,896 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/e93b5a5265904c888ea42e498659816b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,899 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/.tmp/f2/50651809d6c74f9ab6ee82572ed59532 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/50651809d6c74f9ab6ee82572ed59532 2023-02-16 14:00:55,899 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f2/b5e7a2ea620a44d891a9f1fa0088995e 2023-02-16 14:00:55,901 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f1/a5866b89dbd8403bbbd96745ec8f4351 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/a5866b89dbd8403bbbd96745ec8f4351 2023-02-16 14:00:55,901 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/1e9e989ac1d3490098cc8deecd75fbe3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,902 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f1/86247a28cf8546deb55e8ebb7b3caee0 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/86247a28cf8546deb55e8ebb7b3caee0 2023-02-16 14:00:55,903 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d8895fbba69fa76f6c0520e57c58dab2 in 154ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,903 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:55,903 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:55,903 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:55,903 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:00:55,903 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. started... 2023-02-16 14:00:55,903 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0604aa4f347536d904962429f66f960e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,908 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/98899dd757f14147924be8249ed67449, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:00:55,910 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/.tmp/f2/aa13550b266d41baa4f34ddf52769ad8 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/aa13550b266d41baa4f34ddf52769ad8 2023-02-16 14:00:55,910 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/50651809d6c74f9ab6ee82572ed59532, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,910 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f1/27b2f0aee5c0479cae760238cd078d47 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/27b2f0aee5c0479cae760238cd078d47 2023-02-16 14:00:55,912 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/86247a28cf8546deb55e8ebb7b3caee0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:00:55,912 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 388f42865c01c412d90447f9567ff8c0 in 168ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,912 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:55,912 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:55,912 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/a5866b89dbd8403bbbd96745ec8f4351, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,913 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:55,913 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:00:55,913 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/.tmp/f2/767cb631d08642eb959ce08256f04eac as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/767cb631d08642eb959ce08256f04eac 2023-02-16 14:00:55,913 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. started... 2023-02-16 14:00:55,913 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:55,913 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:55,913 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:00:55,915 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/.tmp/f2/e423df28598d4056a9ad3616a0701bc2 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e423df28598d4056a9ad3616a0701bc2 2023-02-16 14:00:55,921 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/aa13550b266d41baa4f34ddf52769ad8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:00:55,922 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for bd3c5bcd9c5ff5a8c5bf643baa21c4b5 in 178ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:55,922 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:55,922 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:00:55,923 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/27b2f0aee5c0479cae760238cd078d47, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,925 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/.tmp/f2/b5e7a2ea620a44d891a9f1fa0088995e as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/b5e7a2ea620a44d891a9f1fa0088995e 2023-02-16 14:00:55,926 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/767cb631d08642eb959ce08256f04eac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:00:55,927 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c1fb0fe4f45a06f8cd3defe169ecc92f in 179ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,927 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:55,928 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:55,928 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:55,928 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. started... 2023-02-16 14:00:55,928 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f8a0a3736f9c989dc61ebaab04927581 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:00:55,928 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:00:55,929 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e423df28598d4056a9ad3616a0701bc2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,931 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7e031fb58194bee0abae88182b415201 in 183ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,932 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f1/a2c4ce1377cb44d996c8970c1b5f5cd2 2023-02-16 14:00:55,932 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:55,932 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:55,932 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:00:55,940 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/b5e7a2ea620a44d891a9f1fa0088995e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,941 INFO [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 in 193ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,941 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:55,941 DEBUG [rs(jenkins-hbase20.apache.org,33377,1676556047740)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:00:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:00:55,942 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,942 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:00:55,942 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33377,1676556047740' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:00:55,944 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:55,944 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:00:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:55,945 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:55,945 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:00:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:55,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:55,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33377,1676556047740' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 14:00:55,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75147a53[Count = 1] remaining members to acquire global barrier 2023-02-16 14:00:55,954 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f1/b5ed705ddf884f99a737f6338237a5ce 2023-02-16 14:00:55,956 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f2/bb44ad242f544fb4875e9068a0a4fc79 2023-02-16 14:00:55,962 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f1/a2c4ce1377cb44d996c8970c1b5f5cd2 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/a2c4ce1377cb44d996c8970c1b5f5cd2 2023-02-16 14:00:55,969 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/a2c4ce1377cb44d996c8970c1b5f5cd2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,970 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/.tmp/f2/bb44ad242f544fb4875e9068a0a4fc79 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/bb44ad242f544fb4875e9068a0a4fc79 2023-02-16 14:00:55,976 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/bb44ad242f544fb4875e9068a0a4fc79, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,977 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0604aa4f347536d904962429f66f960e in 74ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:55,977 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:55,978 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:55,978 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:00:55,980 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f2/c223e0b2f4034c73b2abf625f0bce727 2023-02-16 14:00:55,985 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f1/b5ed705ddf884f99a737f6338237a5ce as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/b5ed705ddf884f99a737f6338237a5ce 2023-02-16 14:00:55,991 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/b5ed705ddf884f99a737f6338237a5ce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:55,992 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/.tmp/f2/c223e0b2f4034c73b2abf625f0bce727 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/c223e0b2f4034c73b2abf625f0bce727 2023-02-16 14:00:55,999 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/c223e0b2f4034c73b2abf625f0bce727, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:00:56,000 INFO [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8a0a3736f9c989dc61ebaab04927581 in 71ms, sequenceid=9, compaction requested=false 2023-02-16 14:00:56,000 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:56,000 DEBUG [rs(jenkins-hbase20.apache.org,44247,1676556047785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:56,000 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:00:56,000 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:00:56,000 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,000 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:00:56,000 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44247,1676556047785' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:00:56,001 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,001 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:00:56,002 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,002 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:00:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:56,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44247,1676556047785' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 14:00:56,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75147a53[Count = 0] remaining members to acquire global barrier 2023-02-16 14:00:56,003 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 14:00:56,004 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,33377,1676556047740' in zk 2023-02-16 14:00:56,005 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:00:56,005 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,44247,1676556047785' in zk 2023-02-16 14:00:56,006 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,006 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:00:56,007 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,007 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:00:56,007 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:56,007 DEBUG [member: 'jenkins-hbase20.apache.org,33377,1676556047740' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:00:56,008 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,007 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:00:56,008 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:56,008 DEBUG [member: 'jenkins-hbase20.apache.org,44247,1676556047785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:00:56,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:56,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:56,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:56,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,33377,1676556047740': 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33377,1676556047740' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,44247,1676556047785': 2023-02-16 14:00:56,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44247,1676556047785' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 14:00:56,015 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 14:00:56,015 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:00:56,015 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:00:56,015 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 14:00:56,015 INFO [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:00:56,019 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,019 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,019 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:00:56,019 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,019 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:00:56,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:56,020 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:00:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:00:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,021 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:00:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,022 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,022 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:00:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:00:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:00:56,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:56,028 DEBUG [(jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:00:56,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:56,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:00:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:00:56,028 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 14:00:56,029 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:00:56,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:00:56,029 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:56,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:00:56,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:00:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:56,029 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:00:56,029 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:56,030 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:00:56,030 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:00:56,031 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 14:00:56,031 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:00:56,131 DEBUG [Listener at localhost.localdomain/44383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:00:56,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:00:56,226 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop-5813694909443435499.jar 2023-02-16 14:00:56,241 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676556053315 type: FLUSH version: 2 ttl: 0 2023-02-16 14:00:56,242 DEBUG [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:56,243 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(239): region to add: f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5 as bd3c5bcd9c5ff5a8c5bf643baa21c4b5 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=7e031fb58194bee0abae88182b415201 as 7e031fb58194bee0abae88182b415201 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=d8895fbba69fa76f6c0520e57c58dab2 as d8895fbba69fa76f6c0520e57c58dab2 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=c1fb0fe4f45a06f8cd3defe169ecc92f as c1fb0fe4f45a06f8cd3defe169ecc92f in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=0604aa4f347536d904962429f66f960e as 0604aa4f347536d904962429f66f960e in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=b24da50fa4c6b14f2f6f513e9bf504fb as b24da50fa4c6b14f2f6f513e9bf504fb in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,244 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5 as 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,245 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=388f42865c01c412d90447f9567ff8c0 as 388f42865c01c412d90447f9567ff8c0 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,245 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=d63ab4d25a0c157a63af30f559a14f1a as d63ab4d25a0c157a63af30f559a14f1a in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,245 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(585): clone region=f8a0a3736f9c989dc61ebaab04927581 as f8a0a3736f9c989dc61ebaab04927581 in snapshot testWithMapReduceMultiRegion 2023-02-16 14:00:56,248 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 0604aa4f347536d904962429f66f960e, NAME => 'testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,248 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bd3c5bcd9c5ff5a8c5bf643baa21c4b5, NAME => 'testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,248 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, NAME => 'testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,248 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => d8895fbba69fa76f6c0520e57c58dab2, NAME => 'testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,249 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7e031fb58194bee0abae88182b415201, NAME => 'testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,249 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 388f42865c01c412d90447f9567ff8c0, NAME => 'testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,249 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c1fb0fe4f45a06f8cd3defe169ecc92f, NAME => 'testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,249 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => b24da50fa4c6b14f2f6f513e9bf504fb, NAME => 'testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,279 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,280 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing b24da50fa4c6b14f2f6f513e9bf504fb, disabling compactions & flushes 2023-02-16 14:00:56,280 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:56,280 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:56,280 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. after waiting 0 ms 2023-02-16 14:00:56,280 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:56,280 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:56,280 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:56,281 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => d63ab4d25a0c157a63af30f559a14f1a, NAME => 'testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,287 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,287 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c523bc64fda4cf5b87b19d34f21fd76 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,300 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1947036add07493097d5f9e167b09b0a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,300 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,301 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b9ea6a182fe54c60a87a8eae19be57b2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,302 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,302 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink efd314fa701e40e6a04b2ea3f39f3864 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,307 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c1fb0fe4f45a06f8cd3defe169ecc92f, disabling compactions & flushes 2023-02-16 14:00:56,307 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:56,307 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:56,307 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,307 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f286a6117bbf4db9bfadf48259254e41 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,307 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. after waiting 0 ms 2023-02-16 14:00:56,307 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:56,308 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:56,308 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:56,308 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f8a0a3736f9c989dc61ebaab04927581, NAME => 'testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,311 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 806056b3737a4406bd536a11775c7017 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,312 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 19c8868cb44245a785e65fe11c1168ba from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,321 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,321 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,321 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 502282555f9e425fab62f943db1cac31 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,321 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8eb4c90f3fc44dee8a449a590b85b601 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,325 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3e7cb16563345409427fba4bac597ad from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,334 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7e031fb58194bee0abae88182b415201, disabling compactions & flushes 2023-02-16 14:00:56,334 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,334 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 0604aa4f347536d904962429f66f960e, disabling compactions & flushes 2023-02-16 14:00:56,335 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51e320c7be5c420584041b2fad0dc76c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,334 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:56,335 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing d63ab4d25a0c157a63af30f559a14f1a, disabling compactions & flushes 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. after waiting 0 ms 2023-02-16 14:00:56,335 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 75b1ef25fada47b5826148b9071e3bb0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,335 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. after waiting 0 ms 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. after waiting 0 ms 2023-02-16 14:00:56,335 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:56,336 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:56,336 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:56,335 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:56,336 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:56,336 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:56,339 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, disabling compactions & flushes 2023-02-16 14:00:56,339 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:56,339 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:56,339 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. after waiting 0 ms 2023-02-16 14:00:56,339 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:56,339 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:56,339 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:56,341 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,341 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ba20f4a0120047d291248e25b61cceb7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bd3c5bcd9c5ff5a8c5bf643baa21c4b5, disabling compactions & flushes 2023-02-16 14:00:56,343 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:56,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:56,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. after waiting 0 ms 2023-02-16 14:00:56,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:56,343 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:56,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:56,347 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing d8895fbba69fa76f6c0520e57c58dab2, disabling compactions & flushes 2023-02-16 14:00:56,348 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0f3fca993d04d049cce7fac708a3cff from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,348 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:56,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:56,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. after waiting 0 ms 2023-02-16 14:00:56,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:56,348 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:56,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:56,350 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f8a0a3736f9c989dc61ebaab04927581, disabling compactions & flushes 2023-02-16 14:00:56,350 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:56,350 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:56,350 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. after waiting 0 ms 2023-02-16 14:00:56,350 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:56,350 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:56,350 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:56,691 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:56,691 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d1a4c33481e40579899036625914300 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,694 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6faea62648774763a1f6dd6d51e0944b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 14:00:56,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 388f42865c01c412d90447f9567ff8c0, disabling compactions & flushes 2023-02-16 14:00:56,696 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:56,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:56,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. after waiting 0 ms 2023-02-16 14:00:56,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:56,696 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:56,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:56,696 INFO [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676556053315 type: FLUSH version: 2 ttl: 0 2023-02-16 14:00:56,696 DEBUG [Listener at localhost.localdomain/44383] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,697 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658 2023-02-16 14:00:56,697 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-data/ 2023-02-16 14:00:56,698 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----default/ 2023-02-16 14:00:56,698 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 14:00:56,699 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------0604aa4f347536d904962429f66f960e/ 2023-02-16 14:00:56,699 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,699 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,700 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=0604aa4f347536d904962429f66f960e-efd314fa701e40e6a04b2ea3f39f3864 2023-02-16 14:00:56,700 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,700 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=0604aa4f347536d904962429f66f960e-806056b3737a4406bd536a11775c7017 2023-02-16 14:00:56,700 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------388f42865c01c412d90447f9567ff8c0/ 2023-02-16 14:00:56,701 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,701 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,701 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=388f42865c01c412d90447f9567ff8c0-2d1a4c33481e40579899036625914300 2023-02-16 14:00:56,701 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,702 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=388f42865c01c412d90447f9567ff8c0-6faea62648774763a1f6dd6d51e0944b 2023-02-16 14:00:56,702 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------55ebb672fa8bd1bfc8ba62e9f2d5e7b5/ 2023-02-16 14:00:56,702 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,702 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,703 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=55ebb672fa8bd1bfc8ba62e9f2d5e7b5-8eb4c90f3fc44dee8a449a590b85b601 2023-02-16 14:00:56,703 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,703 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=55ebb672fa8bd1bfc8ba62e9f2d5e7b5-51e320c7be5c420584041b2fad0dc76c 2023-02-16 14:00:56,703 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------7e031fb58194bee0abae88182b415201/ 2023-02-16 14:00:56,704 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,704 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,704 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=7e031fb58194bee0abae88182b415201-f286a6117bbf4db9bfadf48259254e41 2023-02-16 14:00:56,704 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,705 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=7e031fb58194bee0abae88182b415201-e3e7cb16563345409427fba4bac597ad 2023-02-16 14:00:56,705 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------b24da50fa4c6b14f2f6f513e9bf504fb/ 2023-02-16 14:00:56,705 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,705 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------bd3c5bcd9c5ff5a8c5bf643baa21c4b5/ 2023-02-16 14:00:56,706 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,706 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,706 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=bd3c5bcd9c5ff5a8c5bf643baa21c4b5-b9ea6a182fe54c60a87a8eae19be57b2 2023-02-16 14:00:56,706 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,707 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=bd3c5bcd9c5ff5a8c5bf643baa21c4b5-19c8868cb44245a785e65fe11c1168ba 2023-02-16 14:00:56,707 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------c1fb0fe4f45a06f8cd3defe169ecc92f/ 2023-02-16 14:00:56,707 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,707 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,708 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=c1fb0fe4f45a06f8cd3defe169ecc92f-7c523bc64fda4cf5b87b19d34f21fd76 2023-02-16 14:00:56,708 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,708 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=c1fb0fe4f45a06f8cd3defe169ecc92f-1947036add07493097d5f9e167b09b0a 2023-02-16 14:00:56,708 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------d63ab4d25a0c157a63af30f559a14f1a/ 2023-02-16 14:00:56,708 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,709 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------d8895fbba69fa76f6c0520e57c58dab2/ 2023-02-16 14:00:56,709 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,709 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,709 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=d8895fbba69fa76f6c0520e57c58dab2-502282555f9e425fab62f943db1cac31 2023-02-16 14:00:56,709 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,710 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=d8895fbba69fa76f6c0520e57c58dab2-75b1ef25fada47b5826148b9071e3bb0 2023-02-16 14:00:56,710 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |----------f8a0a3736f9c989dc61ebaab04927581/ 2023-02-16 14:00:56,710 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:00:56,710 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:00:56,711 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=f8a0a3736f9c989dc61ebaab04927581-ba20f4a0120047d291248e25b61cceb7 2023-02-16 14:00:56,711 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:00:56,711 DEBUG [Listener at localhost.localdomain/44383] util.CommonFSUtils(702): |----------------testWithMapReduce=f8a0a3736f9c989dc61ebaab04927581-e0f3fca993d04d049cce7fac708a3cff 2023-02-16 14:00:56,718 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,719 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,719 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,720 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,720 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,721 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,721 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,800 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop-3736383101316400743.jar 2023-02-16 14:00:56,801 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,801 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,801 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,802 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,802 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,802 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,803 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 14:00:56,803 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 14:00:56,804 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 14:00:56,804 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 14:00:56,805 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 14:00:56,805 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 14:00:56,806 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 14:00:56,807 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 14:00:56,807 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 14:00:56,808 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 14:00:56,814 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:00:56,815 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:00:56,815 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:00:56,815 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:00:56,816 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:00:56,851 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:00:56,851 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 14:00:56,887 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop-6364074445622519560.jar 2023-02-16 14:00:56,888 DEBUG [Listener at localhost.localdomain/44383] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:00:56,937 WARN [Listener at localhost.localdomain/44383] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 14:00:57,004 INFO [Listener at localhost.localdomain/44383] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 14:00:57,409 WARN [Listener at localhost.localdomain/44383] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/mapreduce.cluster.local.dir/1676556057330/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 14:00:57,409 WARN [Listener at localhost.localdomain/44383] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/mapreduce.cluster.local.dir/1676556057330/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 14:00:57,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:57,567 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:57,569 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:57,575 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:57,577 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1 2023-02-16 14:00:57,577 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0604aa4f347536d904962429f66f960e columnFamilyName f1 2023-02-16 14:00:57,629 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/testWithMapReduce=0604aa4f347536d904962429f66f960e-efd314fa701e40e6a04b2ea3f39f3864 2023-02-16 14:00:57,630 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(310): Store=0604aa4f347536d904962429f66f960e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,630 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:57,632 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2 2023-02-16 14:00:57,632 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0604aa4f347536d904962429f66f960e columnFamilyName f2 2023-02-16 14:00:57,646 DEBUG [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/testWithMapReduce=0604aa4f347536d904962429f66f960e-806056b3737a4406bd536a11775c7017 2023-02-16 14:00:57,646 INFO [StoreOpener-0604aa4f347536d904962429f66f960e-1] regionserver.HStore(310): Store=0604aa4f347536d904962429f66f960e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,647 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:57,647 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0604aa4f347536d904962429f66f960e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61885420, jitterRate=-0.07783538103103638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:57,647 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:57,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0604aa4f347536d904962429f66f960e, disabling compactions & flushes 2023-02-16 14:00:57,830 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:57,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:57,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. after waiting 0 ms 2023-02-16 14:00:57,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:57,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:57,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:57,872 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:57,872 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:57,876 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:57,879 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:57,883 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1 2023-02-16 14:00:57,884 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 columnFamilyName f1 2023-02-16 14:00:57,892 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/testWithMapReduce=55ebb672fa8bd1bfc8ba62e9f2d5e7b5-8eb4c90f3fc44dee8a449a590b85b601 2023-02-16 14:00:57,892 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(310): Store=55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,892 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:57,893 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2 2023-02-16 14:00:57,894 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 columnFamilyName f2 2023-02-16 14:00:57,900 DEBUG [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/testWithMapReduce=55ebb672fa8bd1bfc8ba62e9f2d5e7b5-51e320c7be5c420584041b2fad0dc76c 2023-02-16 14:00:57,900 INFO [StoreOpener-55ebb672fa8bd1bfc8ba62e9f2d5e7b5-1] regionserver.HStore(310): Store=55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:57,901 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 55ebb672fa8bd1bfc8ba62e9f2d5e7b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73071840, jitterRate=0.08885526657104492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:57,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:57,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, disabling compactions & flushes 2023-02-16 14:00:57,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:57,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:57,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. after waiting 0 ms 2023-02-16 14:00:57,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:57,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:57,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:57,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:57,956 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:57,963 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:57,968 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:57,970 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1 2023-02-16 14:00:57,971 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 388f42865c01c412d90447f9567ff8c0 columnFamilyName f1 2023-02-16 14:00:57,984 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/testWithMapReduce=388f42865c01c412d90447f9567ff8c0-2d1a4c33481e40579899036625914300 2023-02-16 14:00:57,985 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(310): Store=388f42865c01c412d90447f9567ff8c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,985 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:57,986 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2 2023-02-16 14:00:57,986 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 388f42865c01c412d90447f9567ff8c0 columnFamilyName f2 2023-02-16 14:00:57,994 DEBUG [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/testWithMapReduce=388f42865c01c412d90447f9567ff8c0-6faea62648774763a1f6dd6d51e0944b 2023-02-16 14:00:57,994 INFO [StoreOpener-388f42865c01c412d90447f9567ff8c0-1] regionserver.HStore(310): Store=388f42865c01c412d90447f9567ff8c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:57,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:57,994 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 388f42865c01c412d90447f9567ff8c0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67385840, jitterRate=0.0041272640228271484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:57,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:58,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 388f42865c01c412d90447f9567ff8c0, disabling compactions & flushes 2023-02-16 14:00:58,030 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:58,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:58,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. after waiting 0 ms 2023-02-16 14:00:58,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:58,036 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:58,036 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:58,040 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,040 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,042 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,044 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:58,045 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1 2023-02-16 14:00:58,045 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e031fb58194bee0abae88182b415201 columnFamilyName f1 2023-02-16 14:00:58,052 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/testWithMapReduce=7e031fb58194bee0abae88182b415201-f286a6117bbf4db9bfadf48259254e41 2023-02-16 14:00:58,052 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(310): Store=7e031fb58194bee0abae88182b415201/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,052 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:58,053 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2 2023-02-16 14:00:58,054 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e031fb58194bee0abae88182b415201 columnFamilyName f2 2023-02-16 14:00:58,064 DEBUG [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/testWithMapReduce=7e031fb58194bee0abae88182b415201-e3e7cb16563345409427fba4bac597ad 2023-02-16 14:00:58,065 INFO [StoreOpener-7e031fb58194bee0abae88182b415201-1] regionserver.HStore(310): Store=7e031fb58194bee0abae88182b415201/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,065 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7e031fb58194bee0abae88182b415201; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74043822, jitterRate=0.10333892703056335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:58,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7e031fb58194bee0abae88182b415201, disabling compactions & flushes 2023-02-16 14:00:58,113 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:58,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:58,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. after waiting 0 ms 2023-02-16 14:00:58,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:58,117 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:58,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:58,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,123 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,126 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,129 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:58,130 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f1 2023-02-16 14:00:58,131 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24da50fa4c6b14f2f6f513e9bf504fb columnFamilyName f1 2023-02-16 14:00:58,132 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(310): Store=b24da50fa4c6b14f2f6f513e9bf504fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,132 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:58,133 DEBUG [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f2 2023-02-16 14:00:58,134 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24da50fa4c6b14f2f6f513e9bf504fb columnFamilyName f2 2023-02-16 14:00:58,134 INFO [StoreOpener-b24da50fa4c6b14f2f6f513e9bf504fb-1] regionserver.HStore(310): Store=b24da50fa4c6b14f2f6f513e9bf504fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b24da50fa4c6b14f2f6f513e9bf504fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59295074, jitterRate=-0.11643454432487488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:58,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b24da50fa4c6b14f2f6f513e9bf504fb, disabling compactions & flushes 2023-02-16 14:00:58,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:58,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:58,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. after waiting 0 ms 2023-02-16 14:00:58,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:58,163 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:58,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:58,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,170 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,171 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,173 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:58,174 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1 2023-02-16 14:00:58,175 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 columnFamilyName f1 2023-02-16 14:00:58,182 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/testWithMapReduce=bd3c5bcd9c5ff5a8c5bf643baa21c4b5-b9ea6a182fe54c60a87a8eae19be57b2 2023-02-16 14:00:58,183 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(310): Store=bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,183 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:58,184 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2 2023-02-16 14:00:58,185 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3c5bcd9c5ff5a8c5bf643baa21c4b5 columnFamilyName f2 2023-02-16 14:00:58,191 DEBUG [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/testWithMapReduce=bd3c5bcd9c5ff5a8c5bf643baa21c4b5-19c8868cb44245a785e65fe11c1168ba 2023-02-16 14:00:58,192 INFO [StoreOpener-bd3c5bcd9c5ff5a8c5bf643baa21c4b5-1] regionserver.HStore(310): Store=bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,192 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bd3c5bcd9c5ff5a8c5bf643baa21c4b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74767024, jitterRate=0.11411547660827637}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:58,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bd3c5bcd9c5ff5a8c5bf643baa21c4b5, disabling compactions & flushes 2023-02-16 14:00:58,224 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:58,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:58,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. after waiting 0 ms 2023-02-16 14:00:58,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:58,227 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:58,227 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:58,232 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,232 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,234 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,236 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:58,238 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f1 2023-02-16 14:00:58,238 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d63ab4d25a0c157a63af30f559a14f1a columnFamilyName f1 2023-02-16 14:00:58,239 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(310): Store=d63ab4d25a0c157a63af30f559a14f1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,239 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:58,240 DEBUG [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f2 2023-02-16 14:00:58,241 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d63ab4d25a0c157a63af30f559a14f1a columnFamilyName f2 2023-02-16 14:00:58,242 INFO [StoreOpener-d63ab4d25a0c157a63af30f559a14f1a-1] regionserver.HStore(310): Store=d63ab4d25a0c157a63af30f559a14f1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,242 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d63ab4d25a0c157a63af30f559a14f1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71552283, jitterRate=0.06621210277080536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:58,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d63ab4d25a0c157a63af30f559a14f1a, disabling compactions & flushes 2023-02-16 14:00:58,252 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:58,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:58,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. after waiting 0 ms 2023-02-16 14:00:58,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:58,253 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:58,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:58,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,259 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,263 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,265 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:58,266 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1 2023-02-16 14:00:58,267 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a0a3736f9c989dc61ebaab04927581 columnFamilyName f1 2023-02-16 14:00:58,273 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/testWithMapReduce=f8a0a3736f9c989dc61ebaab04927581-ba20f4a0120047d291248e25b61cceb7 2023-02-16 14:00:58,274 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(310): Store=f8a0a3736f9c989dc61ebaab04927581/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,274 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:58,275 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2 2023-02-16 14:00:58,275 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a0a3736f9c989dc61ebaab04927581 columnFamilyName f2 2023-02-16 14:00:58,280 DEBUG [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/testWithMapReduce=f8a0a3736f9c989dc61ebaab04927581-e0f3fca993d04d049cce7fac708a3cff 2023-02-16 14:00:58,281 INFO [StoreOpener-f8a0a3736f9c989dc61ebaab04927581-1] regionserver.HStore(310): Store=f8a0a3736f9c989dc61ebaab04927581/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,281 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8a0a3736f9c989dc61ebaab04927581; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64626014, jitterRate=-0.03699734807014465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:58,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8a0a3736f9c989dc61ebaab04927581, disabling compactions & flushes 2023-02-16 14:00:58,307 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:58,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:58,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. after waiting 0 ms 2023-02-16 14:00:58,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:58,311 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:58,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:58,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,315 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,323 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,325 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:58,326 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1 2023-02-16 14:00:58,327 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8895fbba69fa76f6c0520e57c58dab2 columnFamilyName f1 2023-02-16 14:00:58,341 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/testWithMapReduce=d8895fbba69fa76f6c0520e57c58dab2-502282555f9e425fab62f943db1cac31 2023-02-16 14:00:58,341 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(310): Store=d8895fbba69fa76f6c0520e57c58dab2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,341 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:58,342 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2 2023-02-16 14:00:58,343 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8895fbba69fa76f6c0520e57c58dab2 columnFamilyName f2 2023-02-16 14:00:58,349 DEBUG [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/testWithMapReduce=d8895fbba69fa76f6c0520e57c58dab2-75b1ef25fada47b5826148b9071e3bb0 2023-02-16 14:00:58,350 INFO [StoreOpener-d8895fbba69fa76f6c0520e57c58dab2-1] regionserver.HStore(310): Store=d8895fbba69fa76f6c0520e57c58dab2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,350 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d8895fbba69fa76f6c0520e57c58dab2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70084248, jitterRate=0.044336676597595215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:58,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d8895fbba69fa76f6c0520e57c58dab2, disabling compactions & flushes 2023-02-16 14:00:58,379 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:58,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:58,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. after waiting 0 ms 2023-02-16 14:00:58,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:58,384 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:58,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:58,388 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:00:58,388 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:00:58,392 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:00:58,394 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:58,395 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1 2023-02-16 14:00:58,395 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1fb0fe4f45a06f8cd3defe169ecc92f columnFamilyName f1 2023-02-16 14:00:58,401 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/testWithMapReduce=c1fb0fe4f45a06f8cd3defe169ecc92f-7c523bc64fda4cf5b87b19d34f21fd76 2023-02-16 14:00:58,401 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(310): Store=c1fb0fe4f45a06f8cd3defe169ecc92f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,401 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:58,402 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2 2023-02-16 14:00:58,402 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1fb0fe4f45a06f8cd3defe169ecc92f columnFamilyName f2 2023-02-16 14:00:58,411 DEBUG [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40397/user/jenkins/test-data/d8b0a228-0ef9-4777-9299-63dbdd3bf8f7/testWithMapReduceMultiRegion/4002855f-dcd1-4161-9931-f6165d649658/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/testWithMapReduce=c1fb0fe4f45a06f8cd3defe169ecc92f-1947036add07493097d5f9e167b09b0a 2023-02-16 14:00:58,411 INFO [StoreOpener-c1fb0fe4f45a06f8cd3defe169ecc92f-1] regionserver.HStore(310): Store=c1fb0fe4f45a06f8cd3defe169ecc92f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:00:58,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:00:58,411 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c1fb0fe4f45a06f8cd3defe169ecc92f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72090131, jitterRate=0.07422666251659393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:00:58,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:58,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c1fb0fe4f45a06f8cd3defe169ecc92f, disabling compactions & flushes 2023-02-16 14:00:58,445 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:58,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:58,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. after waiting 0 ms 2023-02-16 14:00:58,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:58,447 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:58,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:59,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceMultiRegion" 2023-02-16 14:00:59,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-16 14:00:59,511 INFO [Listener at localhost.localdomain/44383] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 14:00:59,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-16 14:00:59,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 14:00:59,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556059521"}]},"ts":"1676556059521"} 2023-02-16 14:00:59,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:00:59,523 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 14:00:59,524 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 14:00:59,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, UNASSIGN}] 2023-02-16 14:00:59,533 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, UNASSIGN 2023-02-16 14:00:59,533 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, UNASSIGN 2023-02-16 14:00:59,533 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, UNASSIGN 2023-02-16 14:00:59,534 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, UNASSIGN 2023-02-16 14:00:59,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, UNASSIGN 2023-02-16 14:00:59,534 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:59,534 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059534"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059534"}]},"ts":"1676556059534"} 2023-02-16 14:00:59,535 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d63ab4d25a0c157a63af30f559a14f1a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:59,535 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:59,535 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059535"}]},"ts":"1676556059535"} 2023-02-16 14:00:59,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0604aa4f347536d904962429f66f960e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:59,536 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059535"}]},"ts":"1676556059535"} 2023-02-16 14:00:59,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d8895fbba69fa76f6c0520e57c58dab2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:59,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059535"}]},"ts":"1676556059535"} 2023-02-16 14:00:59,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556059535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059535"}]},"ts":"1676556059535"} 2023-02-16 14:00:59,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=40, state=RUNNABLE; CloseRegionProcedure 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:59,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=42, state=RUNNABLE; CloseRegionProcedure bd3c5bcd9c5ff5a8c5bf643baa21c4b5, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:59,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure 0604aa4f347536d904962429f66f960e, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:59,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure d63ab4d25a0c157a63af30f559a14f1a, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:59,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure d8895fbba69fa76f6c0520e57c58dab2, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:59,580 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, UNASSIGN 2023-02-16 14:00:59,580 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, UNASSIGN 2023-02-16 14:00:59,581 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, UNASSIGN 2023-02-16 14:00:59,582 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, UNASSIGN 2023-02-16 14:00:59,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, UNASSIGN 2023-02-16 14:00:59,582 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=388f42865c01c412d90447f9567ff8c0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:59,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059582"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059582"}]},"ts":"1676556059582"} 2023-02-16 14:00:59,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f8a0a3736f9c989dc61ebaab04927581, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:59,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059583"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059583"}]},"ts":"1676556059583"} 2023-02-16 14:00:59,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7e031fb58194bee0abae88182b415201, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:59,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059584"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059584"}]},"ts":"1676556059584"} 2023-02-16 14:00:59,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b24da50fa4c6b14f2f6f513e9bf504fb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:00:59,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556059584"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059584"}]},"ts":"1676556059584"} 2023-02-16 14:00:59,585 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c1fb0fe4f45a06f8cd3defe169ecc92f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:00:59,585 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059585"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556059585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556059585"}]},"ts":"1676556059585"} 2023-02-16 14:00:59,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 388f42865c01c412d90447f9567ff8c0, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:59,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure f8a0a3736f9c989dc61ebaab04927581, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:59,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=34, state=RUNNABLE; CloseRegionProcedure b24da50fa4c6b14f2f6f513e9bf504fb, server=jenkins-hbase20.apache.org,33377,1676556047740}] 2023-02-16 14:00:59,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure c1fb0fe4f45a06f8cd3defe169ecc92f, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:59,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 7e031fb58194bee0abae88182b415201, server=jenkins-hbase20.apache.org,44247,1676556047785}] 2023-02-16 14:00:59,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:00:59,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:59,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bd3c5bcd9c5ff5a8c5bf643baa21c4b5, disabling compactions & flushes 2023-02-16 14:00:59,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:59,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:59,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. after waiting 0 ms 2023-02-16 14:00:59,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:59,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:59,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f8a0a3736f9c989dc61ebaab04927581, disabling compactions & flushes 2023-02-16 14:00:59,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:59,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:59,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. after waiting 0 ms 2023-02-16 14:00:59,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:59,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5. 2023-02-16 14:00:59,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bd3c5bcd9c5ff5a8c5bf643baa21c4b5: 2023-02-16 14:00:59,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581. 2023-02-16 14:00:59,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f8a0a3736f9c989dc61ebaab04927581: 2023-02-16 14:00:59,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:00:59,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, disabling compactions & flushes 2023-02-16 14:00:59,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. after waiting 0 ms 2023-02-16 14:00:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:59,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, regionState=CLOSED 2023-02-16 14:00:59,771 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059770"}]},"ts":"1676556059770"} 2023-02-16 14:00:59,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:00:59,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:59,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d8895fbba69fa76f6c0520e57c58dab2, disabling compactions & flushes 2023-02-16 14:00:59,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:59,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:59,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. after waiting 0 ms 2023-02-16 14:00:59,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:59,772 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f8a0a3736f9c989dc61ebaab04927581, regionState=CLOSED 2023-02-16 14:00:59,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059772"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059772"}]},"ts":"1676556059772"} 2023-02-16 14:00:59,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=42 2023-02-16 14:00:59,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=42, state=SUCCESS; CloseRegionProcedure bd3c5bcd9c5ff5a8c5bf643baa21c4b5, server=jenkins-hbase20.apache.org,33377,1676556047740 in 214 msec 2023-02-16 14:00:59,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-16 14:00:59,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure f8a0a3736f9c989dc61ebaab04927581, server=jenkins-hbase20.apache.org,44247,1676556047785 in 188 msec 2023-02-16 14:00:59,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bd3c5bcd9c5ff5a8c5bf643baa21c4b5, UNASSIGN in 247 msec 2023-02-16 14:00:59,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8a0a3736f9c989dc61ebaab04927581, UNASSIGN in 251 msec 2023-02-16 14:00:59,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2. 2023-02-16 14:00:59,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d8895fbba69fa76f6c0520e57c58dab2: 2023-02-16 14:00:59,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5. 2023-02-16 14:00:59,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 55ebb672fa8bd1bfc8ba62e9f2d5e7b5: 2023-02-16 14:00:59,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:00:59,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:59,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0604aa4f347536d904962429f66f960e, disabling compactions & flushes 2023-02-16 14:00:59,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:59,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:59,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. after waiting 0 ms 2023-02-16 14:00:59,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:59,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d8895fbba69fa76f6c0520e57c58dab2, regionState=CLOSED 2023-02-16 14:00:59,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059824"}]},"ts":"1676556059824"} 2023-02-16 14:00:59,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:00:59,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:00:59,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:59,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 388f42865c01c412d90447f9567ff8c0, disabling compactions & flushes 2023-02-16 14:00:59,826 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, regionState=CLOSED 2023-02-16 14:00:59,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:59,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:59,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. after waiting 0 ms 2023-02-16 14:00:59,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:59,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059826"}]},"ts":"1676556059826"} 2023-02-16 14:00:59,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=40 2023-02-16 14:00:59,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e. 2023-02-16 14:00:59,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=40, state=SUCCESS; CloseRegionProcedure 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, server=jenkins-hbase20.apache.org,33377,1676556047740 in 274 msec 2023-02-16 14:00:59,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0604aa4f347536d904962429f66f960e: 2023-02-16 14:00:59,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-16 14:00:59,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure d8895fbba69fa76f6c0520e57c58dab2, server=jenkins-hbase20.apache.org,44247,1676556047785 in 268 msec 2023-02-16 14:00:59,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d8895fbba69fa76f6c0520e57c58dab2, UNASSIGN in 313 msec 2023-02-16 14:00:59,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0604aa4f347536d904962429f66f960e 2023-02-16 14:00:59,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=55ebb672fa8bd1bfc8ba62e9f2d5e7b5, UNASSIGN in 312 msec 2023-02-16 14:00:59,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:59,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing c1fb0fe4f45a06f8cd3defe169ecc92f, disabling compactions & flushes 2023-02-16 14:00:59,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:59,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:59,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. after waiting 0 ms 2023-02-16 14:00:59,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:59,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0604aa4f347536d904962429f66f960e, regionState=CLOSED 2023-02-16 14:00:59,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059847"}]},"ts":"1676556059847"} 2023-02-16 14:00:59,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0. 2023-02-16 14:00:59,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 388f42865c01c412d90447f9567ff8c0: 2023-02-16 14:00:59,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-16 14:00:59,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure 0604aa4f347536d904962429f66f960e, server=jenkins-hbase20.apache.org,44247,1676556047785 in 290 msec 2023-02-16 14:00:59,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 388f42865c01c412d90447f9567ff8c0 2023-02-16 14:00:59,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:59,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b24da50fa4c6b14f2f6f513e9bf504fb, disabling compactions & flushes 2023-02-16 14:00:59,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:59,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:59,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. after waiting 0 ms 2023-02-16 14:00:59,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:59,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=388f42865c01c412d90447f9567ff8c0, regionState=CLOSED 2023-02-16 14:00:59,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059863"}]},"ts":"1676556059863"} 2023-02-16 14:00:59,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0604aa4f347536d904962429f66f960e, UNASSIGN in 335 msec 2023-02-16 14:00:59,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-16 14:00:59,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 388f42865c01c412d90447f9567ff8c0, server=jenkins-hbase20.apache.org,33377,1676556047740 in 279 msec 2023-02-16 14:00:59,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=388f42865c01c412d90447f9567ff8c0, UNASSIGN in 342 msec 2023-02-16 14:00:59,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:00:59,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb. 2023-02-16 14:00:59,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b24da50fa4c6b14f2f6f513e9bf504fb: 2023-02-16 14:00:59,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:00:59,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:59,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d63ab4d25a0c157a63af30f559a14f1a, disabling compactions & flushes 2023-02-16 14:00:59,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:59,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:59,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. after waiting 0 ms 2023-02-16 14:00:59,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:59,889 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b24da50fa4c6b14f2f6f513e9bf504fb, regionState=CLOSED 2023-02-16 14:00:59,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556059889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059889"}]},"ts":"1676556059889"} 2023-02-16 14:00:59,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=34 2023-02-16 14:00:59,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=34, state=SUCCESS; CloseRegionProcedure b24da50fa4c6b14f2f6f513e9bf504fb, server=jenkins-hbase20.apache.org,33377,1676556047740 in 307 msec 2023-02-16 14:00:59,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:00:59,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a. 2023-02-16 14:00:59,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f. 2023-02-16 14:00:59,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for c1fb0fe4f45a06f8cd3defe169ecc92f: 2023-02-16 14:00:59,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b24da50fa4c6b14f2f6f513e9bf504fb, UNASSIGN in 375 msec 2023-02-16 14:00:59,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d63ab4d25a0c157a63af30f559a14f1a: 2023-02-16 14:00:59,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:00:59,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:59,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7e031fb58194bee0abae88182b415201, disabling compactions & flushes 2023-02-16 14:00:59,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:59,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:59,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. after waiting 0 ms 2023-02-16 14:00:59,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:59,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c1fb0fe4f45a06f8cd3defe169ecc92f, regionState=CLOSED 2023-02-16 14:00:59,913 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059913"}]},"ts":"1676556059913"} 2023-02-16 14:00:59,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:00:59,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d63ab4d25a0c157a63af30f559a14f1a, regionState=CLOSED 2023-02-16 14:00:59,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556059914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059914"}]},"ts":"1676556059914"} 2023-02-16 14:00:59,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-16 14:00:59,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure c1fb0fe4f45a06f8cd3defe169ecc92f, server=jenkins-hbase20.apache.org,44247,1676556047785 in 327 msec 2023-02-16 14:00:59,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-16 14:00:59,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure d63ab4d25a0c157a63af30f559a14f1a, server=jenkins-hbase20.apache.org,33377,1676556047740 in 361 msec 2023-02-16 14:00:59,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c1fb0fe4f45a06f8cd3defe169ecc92f, UNASSIGN in 398 msec 2023-02-16 14:00:59,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d63ab4d25a0c157a63af30f559a14f1a, UNASSIGN in 396 msec 2023-02-16 14:00:59,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:00:59,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201. 2023-02-16 14:00:59,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7e031fb58194bee0abae88182b415201: 2023-02-16 14:00:59,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 7e031fb58194bee0abae88182b415201 2023-02-16 14:00:59,958 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7e031fb58194bee0abae88182b415201, regionState=CLOSED 2023-02-16 14:00:59,958 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556059958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556059958"}]},"ts":"1676556059958"} 2023-02-16 14:00:59,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-16 14:00:59,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 7e031fb58194bee0abae88182b415201, server=jenkins-hbase20.apache.org,44247,1676556047785 in 365 msec 2023-02-16 14:00:59,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-16 14:00:59,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e031fb58194bee0abae88182b415201, UNASSIGN in 437 msec 2023-02-16 14:00:59,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556059974"}]},"ts":"1676556059974"} 2023-02-16 14:00:59,976 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 14:01:00,063 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 14:01:00,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 613 msec 2023-02-16 14:01:00,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:01:00,132 INFO [Listener at localhost.localdomain/44383] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-16 14:01:00,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-16 14:01:00,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,145 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:01:00,161 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:01:00,167 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/recovered.edits] 2023-02-16 14:01:00,167 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/recovered.edits] 2023-02-16 14:01:00,167 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/recovered.edits] 2023-02-16 14:01:00,167 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/recovered.edits] 2023-02-16 14:01:00,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/recovered.edits] 2023-02-16 14:01:00,168 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/recovered.edits] 2023-02-16 14:01:00,168 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/recovered.edits] 2023-02-16 14:01:00,169 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/recovered.edits] 2023-02-16 14:01:00,180 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/220c056bfe304a988010b02d46ca00a6 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/220c056bfe304a988010b02d46ca00a6 2023-02-16 14:01:00,180 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/2d1a4c33481e40579899036625914300 2023-02-16 14:01:00,180 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/7c523bc64fda4cf5b87b19d34f21fd76 2023-02-16 14:01:00,180 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/a5866b89dbd8403bbbd96745ec8f4351 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/a5866b89dbd8403bbbd96745ec8f4351 2023-02-16 14:01:00,181 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/27b2f0aee5c0479cae760238cd078d47 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/27b2f0aee5c0479cae760238cd078d47 2023-02-16 14:01:00,181 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/a2c4ce1377cb44d996c8970c1b5f5cd2 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/a2c4ce1377cb44d996c8970c1b5f5cd2 2023-02-16 14:01:00,182 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/b5ed705ddf884f99a737f6338237a5ce to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/b5ed705ddf884f99a737f6338237a5ce 2023-02-16 14:01:00,184 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/e93b5a5265904c888ea42e498659816b to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f1/e93b5a5265904c888ea42e498659816b 2023-02-16 14:01:00,184 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f1/f286a6117bbf4db9bfadf48259254e41 2023-02-16 14:01:00,184 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/86247a28cf8546deb55e8ebb7b3caee0 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f1/86247a28cf8546deb55e8ebb7b3caee0 2023-02-16 14:01:00,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f1/502282555f9e425fab62f943db1cac31 2023-02-16 14:01:00,185 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f1/8eb4c90f3fc44dee8a449a590b85b601 2023-02-16 14:01:00,185 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/recovered.edits/6.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb/recovered.edits/6.seqid 2023-02-16 14:01:00,186 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f1/ba20f4a0120047d291248e25b61cceb7 2023-02-16 14:01:00,186 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f1/efd314fa701e40e6a04b2ea3f39f3864 2023-02-16 14:01:00,188 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/b24da50fa4c6b14f2f6f513e9bf504fb 2023-02-16 14:01:00,188 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:01:00,193 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e3e7cb16563345409427fba4bac597ad 2023-02-16 14:01:00,193 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/recovered.edits] 2023-02-16 14:01:00,193 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/1e9e989ac1d3490098cc8deecd75fbe3 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/1e9e989ac1d3490098cc8deecd75fbe3 2023-02-16 14:01:00,235 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/50651809d6c74f9ab6ee82572ed59532 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/50651809d6c74f9ab6ee82572ed59532 2023-02-16 14:01:00,235 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/1947036add07493097d5f9e167b09b0a 2023-02-16 14:01:00,235 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/c223e0b2f4034c73b2abf625f0bce727 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/c223e0b2f4034c73b2abf625f0bce727 2023-02-16 14:01:00,235 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/806056b3737a4406bd536a11775c7017 2023-02-16 14:01:00,235 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/51e320c7be5c420584041b2fad0dc76c 2023-02-16 14:01:00,237 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e423df28598d4056a9ad3616a0701bc2 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/f2/e423df28598d4056a9ad3616a0701bc2 2023-02-16 14:01:00,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/f2/75b1ef25fada47b5826148b9071e3bb0 2023-02-16 14:01:00,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/f2/e0f3fca993d04d049cce7fac708a3cff 2023-02-16 14:01:00,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/767cb631d08642eb959ce08256f04eac to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/f2/767cb631d08642eb959ce08256f04eac 2023-02-16 14:01:00,239 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/b5e7a2ea620a44d891a9f1fa0088995e to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/f2/b5e7a2ea620a44d891a9f1fa0088995e 2023-02-16 14:01:00,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/f2/6faea62648774763a1f6dd6d51e0944b 2023-02-16 14:01:00,240 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/98899dd757f14147924be8249ed67449 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/98899dd757f14147924be8249ed67449 2023-02-16 14:01:00,240 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/bb44ad242f544fb4875e9068a0a4fc79 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/f2/bb44ad242f544fb4875e9068a0a4fc79 2023-02-16 14:01:00,248 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f1/b9ea6a182fe54c60a87a8eae19be57b2 2023-02-16 14:01:00,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 14:01:00,252 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201/recovered.edits/12.seqid 2023-02-16 14:01:00,253 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/7e031fb58194bee0abae88182b415201 2023-02-16 14:01:00,254 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:01:00,255 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0/recovered.edits/12.seqid 2023-02-16 14:01:00,255 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581/recovered.edits/12.seqid 2023-02-16 14:01:00,257 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/f8a0a3736f9c989dc61ebaab04927581 2023-02-16 14:01:00,258 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f/recovered.edits/12.seqid 2023-02-16 14:01:00,258 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/388f42865c01c412d90447f9567ff8c0 2023-02-16 14:01:00,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2/recovered.edits/12.seqid 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/19c8868cb44245a785e65fe11c1168ba 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/c1fb0fe4f45a06f8cd3defe169ecc92f 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5/recovered.edits/12.seqid 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e/recovered.edits/12.seqid 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f1, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/f2, FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/recovered.edits] 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d8895fbba69fa76f6c0520e57c58dab2 2023-02-16 14:01:00,259 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/55ebb672fa8bd1bfc8ba62e9f2d5e7b5 2023-02-16 14:01:00,269 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/0604aa4f347536d904962429f66f960e 2023-02-16 14:01:00,270 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/aa13550b266d41baa4f34ddf52769ad8 to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/f2/aa13550b266d41baa4f34ddf52769ad8 2023-02-16 14:01:00,274 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/recovered.edits/12.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5/recovered.edits/12.seqid 2023-02-16 14:01:00,275 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/bd3c5bcd9c5ff5a8c5bf643baa21c4b5 2023-02-16 14:01:00,275 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/recovered.edits/6.seqid to hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/archive/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a/recovered.edits/6.seqid 2023-02-16 14:01:00,276 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/.tmp/data/default/testWithMapReduce/d63ab4d25a0c157a63af30f559a14f1a 2023-02-16 14:01:00,276 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 14:01:00,283 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,305 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-16 14:01:00,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676556050655.7e031fb58194bee0abae88182b415201.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556060312"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,317 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 14:01:00,318 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b24da50fa4c6b14f2f6f513e9bf504fb, NAME => 'testWithMapReduce,,1676556050655.b24da50fa4c6b14f2f6f513e9bf504fb.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => c1fb0fe4f45a06f8cd3defe169ecc92f, NAME => 'testWithMapReduce,aaa,1676556050655.c1fb0fe4f45a06f8cd3defe169ecc92f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 7e031fb58194bee0abae88182b415201, NAME => 'testWithMapReduce,d\x84\x84,1676556050655.7e031fb58194bee0abae88182b415201.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 388f42865c01c412d90447f9567ff8c0, NAME => 'testWithMapReduce,g\xA7\xA7,1676556050655.388f42865c01c412d90447f9567ff8c0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => f8a0a3736f9c989dc61ebaab04927581, NAME => 'testWithMapReduce,j\xCA\xCA,1676556050655.f8a0a3736f9c989dc61ebaab04927581.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => d8895fbba69fa76f6c0520e57c58dab2, NAME => 'testWithMapReduce,m\xED\xED,1676556050655.d8895fbba69fa76f6c0520e57c58dab2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 55ebb672fa8bd1bfc8ba62e9f2d5e7b5, NAME => 'testWithMapReduce,q\x11\x10,1676556050655.55ebb672fa8bd1bfc8ba62e9f2d5e7b5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 0604aa4f347536d904962429f66f960e, NAME => 'testWithMapReduce,t43,1676556050655.0604aa4f347536d904962429f66f960e.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => bd3c5bcd9c5ff5a8c5bf643baa21c4b5, NAME => 'testWithMapReduce,wWV,1676556050655.bd3c5bcd9c5ff5a8c5bf643baa21c4b5.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => d63ab4d25a0c157a63af30f559a14f1a, NAME => 'testWithMapReduce,zz{,1676556050655.d63ab4d25a0c157a63af30f559a14f1a.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 14:01:00,318 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 14:01:00,318 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556060318"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:00,320 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 14:01:00,322 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:00,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 185 msec 2023-02-16 14:01:00,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 14:01:00,451 INFO [Listener at localhost.localdomain/44383] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-16 14:01:00,452 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:00,452 INFO [Listener at localhost.localdomain/44383] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:00,452 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54e921cf to 127.0.0.1:49697 2023-02-16 14:01:00,452 DEBUG [Listener at localhost.localdomain/44383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,452 DEBUG [Listener at localhost.localdomain/44383] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:00,452 DEBUG [Listener at localhost.localdomain/44383] util.JVMClusterUtil(257): Found active master hash=986602447, stopped=false 2023-02-16 14:01:00,452 INFO [Listener at localhost.localdomain/44383] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:01:00,454 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:00,454 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:00,454 INFO [Listener at localhost.localdomain/44383] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:00,454 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:00,455 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:00,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:00,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:00,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:00,456 DEBUG [Listener at localhost.localdomain/44383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f5dc7ae to 127.0.0.1:49697 2023-02-16 14:01:00,456 DEBUG [Listener at localhost.localdomain/44383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,456 INFO [Listener at localhost.localdomain/44383] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33377,1676556047740' ***** 2023-02-16 14:01:00,456 INFO [Listener at localhost.localdomain/44383] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:00,456 INFO [Listener at localhost.localdomain/44383] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44247,1676556047785' ***** 2023-02-16 14:01:00,456 INFO [Listener at localhost.localdomain/44383] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:00,457 INFO [RS:0;jenkins-hbase20:33377] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:00,457 INFO [RS:1;jenkins-hbase20:44247] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:00,457 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:00,457 INFO [RS:0;jenkins-hbase20:33377] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:00,457 INFO [RS:1;jenkins-hbase20:44247] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:00,457 INFO [RS:0;jenkins-hbase20:33377] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:00,457 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:01:00,457 DEBUG [RS:0;jenkins-hbase20:33377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35bafbd1 to 127.0.0.1:49697 2023-02-16 14:01:00,458 DEBUG [RS:0;jenkins-hbase20:33377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,457 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:00,458 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33377,1676556047740; all regions closed. 2023-02-16 14:01:00,457 INFO [RS:1;jenkins-hbase20:44247] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:00,459 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(3304): Received CLOSE for 829710608b5ef79ea7673beab4585f84 2023-02-16 14:01:00,459 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:01:00,459 DEBUG [RS:1;jenkins-hbase20:44247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e8677be to 127.0.0.1:49697 2023-02-16 14:01:00,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 829710608b5ef79ea7673beab4585f84, disabling compactions & flushes 2023-02-16 14:01:00,460 DEBUG [RS:1;jenkins-hbase20:44247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:01:00,460 INFO [RS:1;jenkins-hbase20:44247] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:00,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:01:00,460 INFO [RS:1;jenkins-hbase20:44247] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:00,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. after waiting 0 ms 2023-02-16 14:01:00,460 INFO [RS:1;jenkins-hbase20:44247] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:00,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:01:00,460 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:00,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 829710608b5ef79ea7673beab4585f84 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:00,460 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 14:01:00,460 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 829710608b5ef79ea7673beab4585f84=hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84.} 2023-02-16 14:01:00,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:00,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:00,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:00,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:00,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:00,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.32 KB heapSize=40.20 KB 2023-02-16 14:01:00,464 DEBUG [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1505): Waiting on 1588230740, 829710608b5ef79ea7673beab4585f84 2023-02-16 14:01:00,468 DEBUG [RS:0;jenkins-hbase20:33377] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33377%2C1676556047740:(num 1676556050148) 2023-02-16 14:01:00,468 DEBUG [RS:0;jenkins-hbase20:33377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:00,468 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:00,468 INFO [RS:0;jenkins-hbase20:33377] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:00,469 INFO [RS:0;jenkins-hbase20:33377] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33377 2023-02-16 14:01:00,477 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:00,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/.tmp/info/0cd6cea605a04e5889515e2a3c6741c3 2023-02-16 14:01:00,477 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:01:00,477 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:00,477 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33377,1676556047740 2023-02-16 14:01:00,478 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@443f2a6d rejected from java.util.concurrent.ThreadPoolExecutor@4000a632[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:00,478 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33377,1676556047740] 2023-02-16 14:01:00,478 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:00,478 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@99c6f69 rejected from java.util.concurrent.ThreadPoolExecutor@4000a632[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:00,478 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33377,1676556047740; numProcessing=1 2023-02-16 14:01:00,479 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33377,1676556047740 already deleted, retry=false 2023-02-16 14:01:00,479 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33377,1676556047740 expired; onlineServers=1 2023-02-16 14:01:00,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.11 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/info/14be9611b2554c2eb7177aea3f1380e3 2023-02-16 14:01:00,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/.tmp/info/0cd6cea605a04e5889515e2a3c6741c3 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/info/0cd6cea605a04e5889515e2a3c6741c3 2023-02-16 14:01:00,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14be9611b2554c2eb7177aea3f1380e3 2023-02-16 14:01:00,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/info/0cd6cea605a04e5889515e2a3c6741c3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:00,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 829710608b5ef79ea7673beab4585f84 in 43ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:00,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/rep_barrier/210f29c4099a423db4cf3ae7c738da1e 2023-02-16 14:01:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/namespace/829710608b5ef79ea7673beab4585f84/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:00,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:01:00,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 829710608b5ef79ea7673beab4585f84: 2023-02-16 14:01:00,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556049711.829710608b5ef79ea7673beab4585f84. 2023-02-16 14:01:00,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 210f29c4099a423db4cf3ae7c738da1e 2023-02-16 14:01:00,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/table/014264a4399c48c99f20269201a867b6 2023-02-16 14:01:00,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 014264a4399c48c99f20269201a867b6 2023-02-16 14:01:00,535 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/info/14be9611b2554c2eb7177aea3f1380e3 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/info/14be9611b2554c2eb7177aea3f1380e3 2023-02-16 14:01:00,536 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:00,536 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:00,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14be9611b2554c2eb7177aea3f1380e3 2023-02-16 14:01:00,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/info/14be9611b2554c2eb7177aea3f1380e3, entries=30, sequenceid=57, filesize=7.9 K 2023-02-16 14:01:00,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/rep_barrier/210f29c4099a423db4cf3ae7c738da1e as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/rep_barrier/210f29c4099a423db4cf3ae7c738da1e 2023-02-16 14:01:00,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 210f29c4099a423db4cf3ae7c738da1e 2023-02-16 14:01:00,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/rep_barrier/210f29c4099a423db4cf3ae7c738da1e, entries=10, sequenceid=57, filesize=5.9 K 2023-02-16 14:01:00,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/.tmp/table/014264a4399c48c99f20269201a867b6 as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/table/014264a4399c48c99f20269201a867b6 2023-02-16 14:01:00,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 014264a4399c48c99f20269201a867b6 2023-02-16 14:01:00,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/table/014264a4399c48c99f20269201a867b6, entries=13, sequenceid=57, filesize=5.9 K 2023-02-16 14:01:00,563 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.32 KB/24908, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=57, compaction requested=false 2023-02-16 14:01:00,577 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 14:01:00,578 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:00,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:00,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:00,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:00,656 INFO [RS:0;jenkins-hbase20:33377] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33377,1676556047740; zookeeper connection closed. 2023-02-16 14:01:00,656 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:00,657 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@713951f8 rejected from java.util.concurrent.ThreadPoolExecutor@4000a632[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:00,657 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ddf29e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ddf29e6 2023-02-16 14:01:00,657 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:33377-0x1016b96cfca0001, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:00,657 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f2003f2 rejected from java.util.concurrent.ThreadPoolExecutor@4000a632[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:00,664 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44247,1676556047785; all regions closed. 2023-02-16 14:01:00,670 DEBUG [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs 2023-02-16 14:01:00,670 INFO [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44247%2C1676556047785.meta:.meta(num 1676556049448) 2023-02-16 14:01:00,683 DEBUG [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/oldWALs 2023-02-16 14:01:00,683 INFO [RS:1;jenkins-hbase20:44247] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44247%2C1676556047785:(num 1676556050149) 2023-02-16 14:01:00,683 DEBUG [RS:1;jenkins-hbase20:44247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,683 INFO [RS:1;jenkins-hbase20:44247] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:00,684 INFO [RS:1;jenkins-hbase20:44247] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:00,684 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:00,685 INFO [RS:1;jenkins-hbase20:44247] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44247 2023-02-16 14:01:00,691 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:00,691 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44247,1676556047785 2023-02-16 14:01:00,691 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44247,1676556047785] 2023-02-16 14:01:00,691 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44247,1676556047785; numProcessing=2 2023-02-16 14:01:00,692 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44247,1676556047785 already deleted, retry=false 2023-02-16 14:01:00,692 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44247,1676556047785 expired; onlineServers=0 2023-02-16 14:01:00,692 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46779,1676556046719' ***** 2023-02-16 14:01:00,692 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:00,692 DEBUG [M:0;jenkins-hbase20:46779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bf351f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:00,692 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46779,1676556046719 2023-02-16 14:01:00,692 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46779,1676556046719; all regions closed. 2023-02-16 14:01:00,693 DEBUG [M:0;jenkins-hbase20:46779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:00,693 DEBUG [M:0;jenkins-hbase20:46779] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:00,693 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:00,693 DEBUG [M:0;jenkins-hbase20:46779] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:00,693 INFO [M:0;jenkins-hbase20:46779] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:00,693 INFO [M:0;jenkins-hbase20:46779] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:00,694 INFO [M:0;jenkins-hbase20:46779] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:00,694 DEBUG [M:0;jenkins-hbase20:46779] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:00,694 INFO [M:0;jenkins-hbase20:46779] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:00,695 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556048953] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556048953,5,FailOnTimeoutGroup] 2023-02-16 14:01:00,695 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556048953] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556048953,5,FailOnTimeoutGroup] 2023-02-16 14:01:00,695 ERROR [M:0;jenkins-hbase20:46779] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-16 14:01:00,697 INFO [M:0;jenkins-hbase20:46779] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:00,697 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:00,699 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:00,699 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:00,699 DEBUG [M:0;jenkins-hbase20:46779] zookeeper.ZKUtil(398): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:00,699 WARN [M:0;jenkins-hbase20:46779] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:00,699 INFO [M:0;jenkins-hbase20:46779] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:00,700 INFO [M:0;jenkins-hbase20:46779] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:00,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:00,701 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:00,701 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:00,701 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:00,701 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:00,701 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:00,701 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.50 KB heapSize=192.48 KB 2023-02-16 14:01:00,731 INFO [M:0;jenkins-hbase20:46779] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.50 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c6c57aaac8c40418de61e8fff16502d 2023-02-16 14:01:00,740 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c6c57aaac8c40418de61e8fff16502d as hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c6c57aaac8c40418de61e8fff16502d 2023-02-16 14:01:00,748 INFO [M:0;jenkins-hbase20:46779] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40397/user/jenkins/test-data/4b110ed2-b654-c1f9-c74c-004ffa285ced/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c6c57aaac8c40418de61e8fff16502d, entries=53, sequenceid=357, filesize=10.4 K 2023-02-16 14:01:00,749 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegion(2947): Finished flush of dataSize ~159.50 KB/163328, heapSize ~192.47 KB/197088, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 48ms, sequenceid=357, compaction requested=false 2023-02-16 14:01:00,752 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:00,752 DEBUG [M:0;jenkins-hbase20:46779] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:00,759 INFO [M:0;jenkins-hbase20:46779] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:00,759 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:00,759 INFO [M:0;jenkins-hbase20:46779] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46779 2023-02-16 14:01:00,765 DEBUG [M:0;jenkins-hbase20:46779] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,46779,1676556046719 already deleted, retry=false 2023-02-16 14:01:01,059 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:01,059 INFO [M:0;jenkins-hbase20:46779] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46779,1676556046719; zookeeper connection closed. 2023-02-16 14:01:01,059 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68d1386e rejected from java.util.concurrent.ThreadPoolExecutor@76431053[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:01,059 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): master:46779-0x1016b96cfca0000, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:01,059 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@621b8374 rejected from java.util.concurrent.ThreadPoolExecutor@76431053[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:01,159 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:01,159 INFO [RS:1;jenkins-hbase20:44247] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44247,1676556047785; zookeeper connection closed. 2023-02-16 14:01:01,159 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4713a81d rejected from java.util.concurrent.ThreadPoolExecutor@432c2427[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:01,159 DEBUG [Listener at localhost.localdomain/44383-EventThread] zookeeper.ZKWatcher(600): regionserver:44247-0x1016b96cfca0002, quorum=127.0.0.1:49697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:01,159 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37193ceb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37193ceb 2023-02-16 14:01:01,160 ERROR [Listener at localhost.localdomain/44383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6debfb43 rejected from java.util.concurrent.ThreadPoolExecutor@432c2427[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:01,160 INFO [Listener at localhost.localdomain/44383] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:01,162 WARN [Listener at localhost.localdomain/44383] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:01,167 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:01,272 WARN [BP-1292119403-148.251.75.209-1676556043606 heartbeating to localhost.localdomain/127.0.0.1:40397] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:01,272 WARN [BP-1292119403-148.251.75.209-1676556043606 heartbeating to localhost.localdomain/127.0.0.1:40397] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1292119403-148.251.75.209-1676556043606 (Datanode Uuid ed3561d4-5c37-4310-baf7-f9db6fd390fd) service to localhost.localdomain/127.0.0.1:40397 2023-02-16 14:01:01,275 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/dfs/data/data3/current/BP-1292119403-148.251.75.209-1676556043606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:01,276 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/dfs/data/data4/current/BP-1292119403-148.251.75.209-1676556043606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:01,277 WARN [Listener at localhost.localdomain/44383] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:01,280 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:01,382 WARN [BP-1292119403-148.251.75.209-1676556043606 heartbeating to localhost.localdomain/127.0.0.1:40397] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:01,382 WARN [BP-1292119403-148.251.75.209-1676556043606 heartbeating to localhost.localdomain/127.0.0.1:40397] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1292119403-148.251.75.209-1676556043606 (Datanode Uuid c35c3670-7cad-47da-ba12-de04c543d8c0) service to localhost.localdomain/127.0.0.1:40397 2023-02-16 14:01:01,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/dfs/data/data1/current/BP-1292119403-148.251.75.209-1676556043606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:01,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/cluster_cd92efbf-9cd5-c27a-4d36-4580e0d183ce/dfs/data/data2/current/BP-1292119403-148.251.75.209-1676556043606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:01,413 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:01,540 INFO [Listener at localhost.localdomain/44383] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:01,606 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:01,617 INFO [Listener at localhost.localdomain/44383] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/44383 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40397 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40397 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40397 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@4020de58 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40397 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,46779,1676556046719)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:40397 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:40397 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40397 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-3-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 126) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 162) - ProcessCount LEAK? -, AvailableMemoryMB=3736 (was 5282) 2023-02-16 14:01:01,629 INFO [Listener at localhost.localdomain/44383] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=166, AvailableMemoryMB=3736 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.log.dir so I do NOT create it in target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5 2023-02-16 14:01:01,638 WARN [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.tmp.dir so I do NOT create it in target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5 2023-02-16 14:01:01,638 WARN [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc211539-cb28-01c3-0791-fb794275c94f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:01,638 DEBUG [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314, deleteOnExit=true 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:01,638 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/test.cache.data in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:01,639 DEBUG [Listener at localhost.localdomain/44383] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:01,639 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:01,640 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:01,641 INFO [Listener at localhost.localdomain/44383] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:01,643 WARN [Listener at localhost.localdomain/44383] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:01,643 WARN [Listener at localhost.localdomain/44383] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:01,669 WARN [Listener at localhost.localdomain/44383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:01,671 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:01,677 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/java.io.tmpdir/Jetty_localhost_localdomain_37335_hdfs____uoh8ej/webapp 2023-02-16 14:01:01,772 INFO [Listener at localhost.localdomain/44383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37335 2023-02-16 14:01:01,775 WARN [Listener at localhost.localdomain/44383] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:01,775 WARN [Listener at localhost.localdomain/44383] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:01,802 WARN [Listener at localhost.localdomain/32983] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:01,815 WARN [Listener at localhost.localdomain/32983] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:01,819 WARN [Listener at localhost.localdomain/32983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:01,820 INFO [Listener at localhost.localdomain/32983] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:01,824 INFO [Listener at localhost.localdomain/32983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/java.io.tmpdir/Jetty_localhost_39937_datanode____92skgu/webapp 2023-02-16 14:01:01,895 INFO [Listener at localhost.localdomain/32983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39937 2023-02-16 14:01:01,903 WARN [Listener at localhost.localdomain/43413] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:01,929 WARN [Listener at localhost.localdomain/43413] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:01,931 WARN [Listener at localhost.localdomain/43413] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:01,932 INFO [Listener at localhost.localdomain/43413] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:01,936 INFO [Listener at localhost.localdomain/43413] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/java.io.tmpdir/Jetty_localhost_46593_datanode____.2nyn2k/webapp 2023-02-16 14:01:02,057 INFO [Listener at localhost.localdomain/43413] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46593 2023-02-16 14:01:02,067 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x268b04ad2285b3e4: Processing first storage report for DS-365d4655-0b04-4a25-9ff3-15d555794cb3 from datanode 73e14bb9-96a6-4e91-b180-b184f17c3ae7 2023-02-16 14:01:02,067 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x268b04ad2285b3e4: from storage DS-365d4655-0b04-4a25-9ff3-15d555794cb3 node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=73e14bb9-96a6-4e91-b180-b184f17c3ae7, infoPort=40693, infoSecurePort=0, ipcPort=43413, storageInfo=lv=-57;cid=testClusterID;nsid=338216477;c=1676556061645), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:02,067 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x268b04ad2285b3e4: Processing first storage report for DS-524feb31-1121-41a9-94bc-7c1aa92c26b3 from datanode 73e14bb9-96a6-4e91-b180-b184f17c3ae7 2023-02-16 14:01:02,067 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x268b04ad2285b3e4: from storage DS-524feb31-1121-41a9-94bc-7c1aa92c26b3 node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=73e14bb9-96a6-4e91-b180-b184f17c3ae7, infoPort=40693, infoSecurePort=0, ipcPort=43413, storageInfo=lv=-57;cid=testClusterID;nsid=338216477;c=1676556061645), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:02,073 WARN [Listener at localhost.localdomain/35977] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:02,161 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9d2d6a1d60d9c6e: Processing first storage report for DS-a59f03b5-df78-4eb0-89b0-239167de05a2 from datanode 99434264-2e26-4036-98e0-78209670cdc2 2023-02-16 14:01:02,161 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9d2d6a1d60d9c6e: from storage DS-a59f03b5-df78-4eb0-89b0-239167de05a2 node DatanodeRegistration(127.0.0.1:44333, datanodeUuid=99434264-2e26-4036-98e0-78209670cdc2, infoPort=37479, infoSecurePort=0, ipcPort=35977, storageInfo=lv=-57;cid=testClusterID;nsid=338216477;c=1676556061645), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:02,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9d2d6a1d60d9c6e: Processing first storage report for DS-73e723a1-a57b-4d92-8710-c19647ad69c7 from datanode 99434264-2e26-4036-98e0-78209670cdc2 2023-02-16 14:01:02,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9d2d6a1d60d9c6e: from storage DS-73e723a1-a57b-4d92-8710-c19647ad69c7 node DatanodeRegistration(127.0.0.1:44333, datanodeUuid=99434264-2e26-4036-98e0-78209670cdc2, infoPort=37479, infoSecurePort=0, ipcPort=35977, storageInfo=lv=-57;cid=testClusterID;nsid=338216477;c=1676556061645), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:02,187 DEBUG [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5 2023-02-16 14:01:02,189 INFO [Listener at localhost.localdomain/35977] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/zookeeper_0, clientPort=55872, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:02,190 INFO [Listener at localhost.localdomain/35977] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55872 2023-02-16 14:01:02,190 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,192 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,211 INFO [Listener at localhost.localdomain/35977] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12 with version=8 2023-02-16 14:01:02,211 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,212 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,213 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/hbase-staging 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:02,215 INFO [Listener at localhost.localdomain/35977] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:02,218 INFO [Listener at localhost.localdomain/35977] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44339 2023-02-16 14:01:02,219 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,220 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,221 INFO [Listener at localhost.localdomain/35977] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44339 connecting to ZooKeeper ensemble=127.0.0.1:55872 2023-02-16 14:01:02,230 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:443390x0, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:02,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44339-0x1016b970f9c0000 connected 2023-02-16 14:01:02,249 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:02,251 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:02,252 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:02,255 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-16 14:01:02,257 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44339 2023-02-16 14:01:02,257 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44339 2023-02-16 14:01:02,260 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-16 14:01:02,262 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-16 14:01:02,262 INFO [Listener at localhost.localdomain/35977] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12, hbase.cluster.distributed=false 2023-02-16 14:01:02,276 INFO [Listener at localhost.localdomain/35977] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:02,277 INFO [Listener at localhost.localdomain/35977] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:02,280 INFO [Listener at localhost.localdomain/35977] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45629 2023-02-16 14:01:02,280 INFO [Listener at localhost.localdomain/35977] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:02,287 DEBUG [Listener at localhost.localdomain/35977] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:02,287 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,288 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,289 INFO [Listener at localhost.localdomain/35977] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45629 connecting to ZooKeeper ensemble=127.0.0.1:55872 2023-02-16 14:01:02,292 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:456290x0, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:02,293 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:456290x0, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:02,294 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:456290x0, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:02,294 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:456290x0, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:02,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45629-0x1016b970f9c0001 connected 2023-02-16 14:01:02,295 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45629 2023-02-16 14:01:02,299 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45629 2023-02-16 14:01:02,301 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45629 2023-02-16 14:01:02,301 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45629 2023-02-16 14:01:02,302 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45629 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:02,312 INFO [Listener at localhost.localdomain/35977] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:02,314 INFO [Listener at localhost.localdomain/35977] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42653 2023-02-16 14:01:02,314 INFO [Listener at localhost.localdomain/35977] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:02,316 DEBUG [Listener at localhost.localdomain/35977] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:02,316 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,317 INFO [Listener at localhost.localdomain/35977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,318 INFO [Listener at localhost.localdomain/35977] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42653 connecting to ZooKeeper ensemble=127.0.0.1:55872 2023-02-16 14:01:02,321 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:426530x0, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:02,323 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:426530x0, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:02,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42653-0x1016b970f9c0002 connected 2023-02-16 14:01:02,324 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:02,324 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:02,327 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42653 2023-02-16 14:01:02,328 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42653 2023-02-16 14:01:02,331 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42653 2023-02-16 14:01:02,331 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42653 2023-02-16 14:01:02,332 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42653 2023-02-16 14:01:02,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,335 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:02,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,336 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:02,336 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:02,336 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:02,337 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,338 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:02,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44339,1676556062214 from backup master directory 2023-02-16 14:01:02,339 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,339 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:02,343 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:02,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:02,362 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/hbase.id with ID: 4cf0965e-ca37-4446-aee3-0a1dcc828238 2023-02-16 14:01:02,375 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:02,378 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7c57e710 to 127.0.0.1:55872 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:02,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c92e5d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:02,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:02,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:02,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:02,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store-tmp 2023-02-16 14:01:02,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:02,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:02,413 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:02,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:02,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:02,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:02,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:02,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:02,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/WALs/jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44339%2C1676556062214, suffix=, logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/WALs/jenkins-hbase20.apache.org,44339,1676556062214, archiveDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:02,431 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK] 2023-02-16 14:01:02,432 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK] 2023-02-16 14:01:02,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/WALs/jenkins-hbase20.apache.org,44339,1676556062214/jenkins-hbase20.apache.org%2C44339%2C1676556062214.1676556062417 2023-02-16 14:01:02,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK]] 2023-02-16 14:01:02,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:02,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:02,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,438 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,440 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,441 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:02,442 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:02,442 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,446 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:02,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:02,448 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70830179, jitterRate=0.05545191466808319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:02,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:02,451 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:02,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:02,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:02,453 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:02,453 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:02,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:02,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:02,455 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:02,456 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:02,466 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:02,466 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:02,467 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:02,467 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:02,468 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:02,469 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:02,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:02,471 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:02,471 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:02,471 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:02,471 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,471 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:02,472 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44339,1676556062214, sessionid=0x1016b970f9c0000, setting cluster-up flag (Was=false) 2023-02-16 14:01:02,475 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,477 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:02,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,480 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,483 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:02,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:02,484 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/.tmp 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:02,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:02,487 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,487 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:02,487 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556092492 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:02,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:02,495 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,495 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:02,495 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:02,495 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:02,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:02,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:02,496 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:02,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:02,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:02,497 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556062497,5,FailOnTimeoutGroup] 2023-02-16 14:01:02,497 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556062497,5,FailOnTimeoutGroup] 2023-02-16 14:01:02,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:02,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,508 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:02,508 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:02,509 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12 2023-02-16 14:01:02,518 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:02,519 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:02,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/info 2023-02-16 14:01:02,521 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:02,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:02,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:02,523 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:02,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:02,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/table 2023-02-16 14:01:02,526 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:02,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,527 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740 2023-02-16 14:01:02,527 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740 2023-02-16 14:01:02,529 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:02,530 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:02,532 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66294997, jitterRate=-0.01212756335735321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:02,532 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:02,532 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:02,533 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:02,533 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:02,534 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:02,534 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:02,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:02,535 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(952): ClusterId : 4cf0965e-ca37-4446-aee3-0a1dcc828238 2023-02-16 14:01:02,535 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(952): ClusterId : 4cf0965e-ca37-4446-aee3-0a1dcc828238 2023-02-16 14:01:02,535 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:02,535 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:02,536 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:02,537 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:02,538 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:02,538 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:02,538 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:02,538 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:02,539 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:02,540 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:02,541 DEBUG [RS:0;jenkins-hbase20:45629] zookeeper.ReadOnlyZKClient(139): Connect 0x68e86e1c to 127.0.0.1:55872 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:02,542 DEBUG [RS:1;jenkins-hbase20:42653] zookeeper.ReadOnlyZKClient(139): Connect 0x1e37dcf4 to 127.0.0.1:55872 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:02,554 DEBUG [RS:1;jenkins-hbase20:42653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f03142, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:02,554 DEBUG [RS:1;jenkins-hbase20:42653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14cfb784, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:02,554 DEBUG [RS:0;jenkins-hbase20:45629] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@662f9d71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:02,555 DEBUG [RS:0;jenkins-hbase20:45629] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6210056c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:02,561 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:45629 2023-02-16 14:01:02,561 INFO [RS:0;jenkins-hbase20:45629] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:02,561 INFO [RS:0;jenkins-hbase20:45629] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:02,561 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:02,562 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44339,1676556062214 with isa=jenkins-hbase20.apache.org/148.251.75.209:45629, startcode=1676556062276 2023-02-16 14:01:02,562 DEBUG [RS:0;jenkins-hbase20:45629] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:02,563 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:42653 2023-02-16 14:01:02,563 INFO [RS:1;jenkins-hbase20:42653] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:02,564 INFO [RS:1;jenkins-hbase20:42653] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:02,564 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:02,565 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44339,1676556062214 with isa=jenkins-hbase20.apache.org/148.251.75.209:42653, startcode=1676556062311 2023-02-16 14:01:02,565 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54741, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:02,565 DEBUG [RS:1;jenkins-hbase20:42653] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:02,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,567 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12 2023-02-16 14:01:02,567 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:32983 2023-02-16 14:01:02,568 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:02,571 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42679, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:02,571 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:02,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,572 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,45629,1676556062276] 2023-02-16 14:01:02,572 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12 2023-02-16 14:01:02,572 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:32983 2023-02-16 14:01:02,572 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:02,578 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:02,578 DEBUG [RS:0;jenkins-hbase20:45629] zookeeper.ZKUtil(162): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,578 WARN [RS:0;jenkins-hbase20:45629] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:02,578 INFO [RS:0;jenkins-hbase20:45629] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:02,578 DEBUG [RS:1;jenkins-hbase20:42653] zookeeper.ZKUtil(162): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,578 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,578 WARN [RS:1;jenkins-hbase20:42653] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:02,578 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42653,1676556062311] 2023-02-16 14:01:02,578 INFO [RS:1;jenkins-hbase20:42653] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:02,578 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,584 DEBUG [RS:1;jenkins-hbase20:42653] zookeeper.ZKUtil(162): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,584 DEBUG [RS:0;jenkins-hbase20:45629] zookeeper.ZKUtil(162): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,585 DEBUG [RS:1;jenkins-hbase20:42653] zookeeper.ZKUtil(162): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,585 DEBUG [RS:0;jenkins-hbase20:45629] zookeeper.ZKUtil(162): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,586 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:02,586 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:02,586 INFO [RS:0;jenkins-hbase20:45629] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:02,586 INFO [RS:1;jenkins-hbase20:42653] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:02,587 INFO [RS:0;jenkins-hbase20:45629] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:02,588 INFO [RS:0;jenkins-hbase20:45629] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:02,588 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,588 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:02,589 INFO [RS:1;jenkins-hbase20:42653] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:02,589 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,589 INFO [RS:1;jenkins-hbase20:42653] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:02,590 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,590 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,590 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,590 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:02,590 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,590 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 DEBUG [RS:0;jenkins-hbase20:45629] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,591 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,592 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,592 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,592 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:02,592 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,593 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,593 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,593 DEBUG [RS:1;jenkins-hbase20:42653] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:02,599 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,599 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,599 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,607 INFO [RS:0;jenkins-hbase20:45629] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:02,607 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45629,1676556062276-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,607 INFO [RS:1;jenkins-hbase20:42653] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:02,608 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42653,1676556062311-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,617 INFO [RS:0;jenkins-hbase20:45629] regionserver.Replication(203): jenkins-hbase20.apache.org,45629,1676556062276 started 2023-02-16 14:01:02,617 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,45629,1676556062276, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:45629, sessionid=0x1016b970f9c0001 2023-02-16 14:01:02,617 INFO [RS:1;jenkins-hbase20:42653] regionserver.Replication(203): jenkins-hbase20.apache.org,42653,1676556062311 started 2023-02-16 14:01:02,618 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42653,1676556062311, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42653, sessionid=0x1016b970f9c0002 2023-02-16 14:01:02,617 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:02,618 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:02,618 DEBUG [RS:0;jenkins-hbase20:45629] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,618 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45629,1676556062276' 2023-02-16 14:01:02,618 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:02,618 DEBUG [RS:1;jenkins-hbase20:42653] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,618 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42653,1676556062311' 2023-02-16 14:01:02,618 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:02,618 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:02,618 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45629,1676556062276' 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42653,1676556062311' 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:02,619 DEBUG [RS:0;jenkins-hbase20:45629] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:02,619 INFO [RS:0;jenkins-hbase20:45629] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:02,619 INFO [RS:0;jenkins-hbase20:45629] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:02,619 DEBUG [RS:1;jenkins-hbase20:42653] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:02,619 INFO [RS:1;jenkins-hbase20:42653] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:02,620 INFO [RS:1;jenkins-hbase20:42653] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:02,688 DEBUG [jenkins-hbase20:44339] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:02,688 DEBUG [jenkins-hbase20:44339] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:02,690 DEBUG [jenkins-hbase20:44339] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:02,690 DEBUG [jenkins-hbase20:44339] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:02,690 DEBUG [jenkins-hbase20:44339] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:02,691 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,45629,1676556062276, state=OPENING 2023-02-16 14:01:02,692 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:02,693 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:02,693 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:02,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:02,846 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:02,847 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:02,849 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:02,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:02,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:02,855 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45629%2C1676556062276.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,45629,1676556062276, archiveDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs, maxLogs=32 2023-02-16 14:01:02,870 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK] 2023-02-16 14:01:02,870 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK] 2023-02-16 14:01:02,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,45629,1676556062276/jenkins-hbase20.apache.org%2C45629%2C1676556062276.meta.1676556062857.meta 2023-02-16 14:01:02,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK]] 2023-02-16 14:01:02,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:02,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:02,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:02,876 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:02,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:02,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:02,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:02,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:02,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:02,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/info 2023-02-16 14:01:02,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/info 2023-02-16 14:01:02,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:02,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:02,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:02,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:02,881 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:02,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:02,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/table 2023-02-16 14:01:02,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/table 2023-02-16 14:01:02,882 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:02,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:02,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740 2023-02-16 14:01:02,885 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740 2023-02-16 14:01:02,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:02,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:02,889 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68687281, jitterRate=0.023520246148109436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:02,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:02,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556062846 2023-02-16 14:01:02,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:02,896 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:02,896 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,45629,1676556062276, state=OPEN 2023-02-16 14:01:02,897 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:02,897 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:02,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:02,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,45629,1676556062276 in 204 msec 2023-02-16 14:01:02,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:02,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-16 14:01:02,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 417 msec 2023-02-16 14:01:02,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556062903, completionTime=-1 2023-02-16 14:01:02,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:02,903 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:02,906 DEBUG [hconnection-0x5784531f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:02,909 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:02,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:02,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556122910 2023-02-16 14:01:02,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556182910 2023-02-16 14:01:02,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-16 14:01:02,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44339,1676556062214-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44339,1676556062214-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44339,1676556062214-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44339, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:02,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:02,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:02,919 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:02,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:02,921 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:02,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/hbase/namespace/07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:02,924 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/hbase/namespace/07905a98381ed79d35a16983bc564c06 empty. 2023-02-16 14:01:02,924 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/hbase/namespace/07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:02,924 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:02,937 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:02,939 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 07905a98381ed79d35a16983bc564c06, NAME => 'hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,352 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 07905a98381ed79d35a16983bc564c06, disabling compactions & flushes 2023-02-16 14:01:03,352 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,352 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,352 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. after waiting 0 ms 2023-02-16 14:01:03,352 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,352 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,352 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 07905a98381ed79d35a16983bc564c06: 2023-02-16 14:01:03,354 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:03,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556063355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063355"}]},"ts":"1676556063355"} 2023-02-16 14:01:03,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:03,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:03,359 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556063359"}]},"ts":"1676556063359"} 2023-02-16 14:01:03,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:03,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:03,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:03,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:03,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:03,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=07905a98381ed79d35a16983bc564c06, ASSIGN}] 2023-02-16 14:01:03,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=07905a98381ed79d35a16983bc564c06, ASSIGN 2023-02-16 14:01:03,366 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=07905a98381ed79d35a16983bc564c06, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,517 INFO [jenkins-hbase20:44339] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:03,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=07905a98381ed79d35a16983bc564c06, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:03,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556063517"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556063517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556063517"}]},"ts":"1676556063517"} 2023-02-16 14:01:03,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 07905a98381ed79d35a16983bc564c06, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:03,621 INFO [RS:1;jenkins-hbase20:42653] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42653%2C1676556062311, suffix=, logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,42653,1676556062311, archiveDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs, maxLogs=32 2023-02-16 14:01:03,621 INFO [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45629%2C1676556062276, suffix=, logDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,45629,1676556062276, archiveDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs, maxLogs=32 2023-02-16 14:01:03,642 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK] 2023-02-16 14:01:03,642 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK] 2023-02-16 14:01:03,645 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK] 2023-02-16 14:01:03,645 INFO [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,45629,1676556062276/jenkins-hbase20.apache.org%2C45629%2C1676556062276.1676556063623 2023-02-16 14:01:03,646 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK] 2023-02-16 14:01:03,646 DEBUG [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK], DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK]] 2023-02-16 14:01:03,652 INFO [RS:1;jenkins-hbase20:42653] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/WALs/jenkins-hbase20.apache.org,42653,1676556062311/jenkins-hbase20.apache.org%2C42653%2C1676556062311.1676556063623 2023-02-16 14:01:03,652 DEBUG [RS:1;jenkins-hbase20:42653] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45693,DS-365d4655-0b04-4a25-9ff3-15d555794cb3,DISK], DatanodeInfoWithStorage[127.0.0.1:44333,DS-a59f03b5-df78-4eb0-89b0-239167de05a2,DISK]] 2023-02-16 14:01:03,672 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:03,672 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:03,676 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:03,680 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 07905a98381ed79d35a16983bc564c06, NAME => 'hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:03,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,682 INFO [StoreOpener-07905a98381ed79d35a16983bc564c06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,684 DEBUG [StoreOpener-07905a98381ed79d35a16983bc564c06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/info 2023-02-16 14:01:03,684 DEBUG [StoreOpener-07905a98381ed79d35a16983bc564c06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/info 2023-02-16 14:01:03,684 INFO [StoreOpener-07905a98381ed79d35a16983bc564c06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07905a98381ed79d35a16983bc564c06 columnFamilyName info 2023-02-16 14:01:03,685 INFO [StoreOpener-07905a98381ed79d35a16983bc564c06-1] regionserver.HStore(310): Store=07905a98381ed79d35a16983bc564c06/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:03,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:03,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:03,696 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 07905a98381ed79d35a16983bc564c06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61402330, jitterRate=-0.08503398299217224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:03,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 07905a98381ed79d35a16983bc564c06: 2023-02-16 14:01:03,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06., pid=6, masterSystemTime=1676556063672 2023-02-16 14:01:03,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,703 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:03,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=07905a98381ed79d35a16983bc564c06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:03,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556063703"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556063703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556063703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556063703"}]},"ts":"1676556063703"} 2023-02-16 14:01:03,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:03,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 07905a98381ed79d35a16983bc564c06, server=jenkins-hbase20.apache.org,42653,1676556062311 in 186 msec 2023-02-16 14:01:03,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:03,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=07905a98381ed79d35a16983bc564c06, ASSIGN in 344 msec 2023-02-16 14:01:03,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:03,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556063710"}]},"ts":"1676556063710"} 2023-02-16 14:01:03,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:03,714 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:03,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 798 msec 2023-02-16 14:01:03,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:03,727 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:03,728 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:03,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:03,733 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:03,736 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:03,747 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:03,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-16 14:01:03,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:03,766 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:03,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-16 14:01:03,782 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:03,783 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:03,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.440sec 2023-02-16 14:01:03,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:03,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:03,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:03,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44339,1676556062214-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:03,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44339,1676556062214-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:03,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:03,835 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ReadOnlyZKClient(139): Connect 0x5f29c90d to 127.0.0.1:55872 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:03,840 DEBUG [Listener at localhost.localdomain/35977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a5476cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:03,842 DEBUG [hconnection-0x1551380b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:03,845 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:03,846 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:03,846 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:03,849 DEBUG [Listener at localhost.localdomain/35977] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:03,851 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:03,851 INFO [Listener at localhost.localdomain/35977] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 14:01:03,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-16 14:01:03,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:03,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 148.251.75.209:51072 deadline: 1676556123852, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 14:01:03,852 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 14:01:03,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:03,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 14:01:03,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:03,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 14:01:03,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:03,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:03,870 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e empty. 2023-02-16 14:01:03,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d empty. 2023-02-16 14:01:03,870 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec empty. 2023-02-16 14:01:03,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333 empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9 empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6 empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5 empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e empty. 2023-02-16 14:01:03,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3 empty. 2023-02-16 14:01:03,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:03,872 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 14:01:03,886 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:03,888 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 42bf7bcdd8d45fbbec523f50ebc1b333, NAME => 'testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,888 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b5eece579c05abd7b46ca8eef60dcb5e, NAME => 'testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,888 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5972a40aaf60a8fdee56ec1a9d05f7f9, NAME => 'testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 42bf7bcdd8d45fbbec523f50ebc1b333, disabling compactions & flushes 2023-02-16 14:01:03,911 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. after waiting 0 ms 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:03,911 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:03,911 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:03,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6b89a06ea80b91c28009516fbf9881c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,913 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,914 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b5eece579c05abd7b46ca8eef60dcb5e, disabling compactions & flushes 2023-02-16 14:01:03,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:03,914 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:03,914 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. after waiting 0 ms 2023-02-16 14:01:03,914 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:03,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:03,914 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:03,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ac527702920deb5385f032a43f483e6, NAME => 'testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,915 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,916 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5972a40aaf60a8fdee56ec1a9d05f7f9, disabling compactions & flushes 2023-02-16 14:01:03,916 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:03,916 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:03,916 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. after waiting 0 ms 2023-02-16 14:01:03,916 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:03,916 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:03,916 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:03,916 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8f501efca2d0ca55f6f916f2d47a8fea, NAME => 'testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6b89a06ea80b91c28009516fbf9881c5, disabling compactions & flushes 2023-02-16 14:01:03,928 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. after waiting 0 ms 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:03,928 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:03,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:03,929 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e972c2f201c4cc45e0bbe50dc31666ec, NAME => 'testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4ac527702920deb5385f032a43f483e6, disabling compactions & flushes 2023-02-16 14:01:03,930 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. after waiting 0 ms 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:03,930 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:03,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:03,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93215024d230adf395c90171b41a1e8d, NAME => 'testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8f501efca2d0ca55f6f916f2d47a8fea, disabling compactions & flushes 2023-02-16 14:01:03,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. after waiting 0 ms 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:03,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:03,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:03,934 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f6896c72887e9953363d11833443458e, NAME => 'testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e972c2f201c4cc45e0bbe50dc31666ec, disabling compactions & flushes 2023-02-16 14:01:03,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. after waiting 0 ms 2023-02-16 14:01:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:03,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:03,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9c3500c833234e63fb20f7bc4d6252f3, NAME => 'testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.tmp 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 93215024d230adf395c90171b41a1e8d, disabling compactions & flushes 2023-02-16 14:01:03,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. after waiting 0 ms 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:03,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f6896c72887e9953363d11833443458e, disabling compactions & flushes 2023-02-16 14:01:03,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. after waiting 0 ms 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:03,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:03,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9c3500c833234e63fb20f7bc4d6252f3, disabling compactions & flushes 2023-02-16 14:01:03,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. after waiting 0 ms 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:03,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:03,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:03,954 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556063954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556063954"}]},"ts":"1676556063954"} 2023-02-16 14:01:03,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 14:01:03,959 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:03,959 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556063959"}]},"ts":"1676556063959"} 2023-02-16 14:01:03,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 14:01:03,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:03,963 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:03,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:03,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:03,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:03,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b5eece579c05abd7b46ca8eef60dcb5e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5972a40aaf60a8fdee56ec1a9d05f7f9, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=42bf7bcdd8d45fbbec523f50ebc1b333, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b89a06ea80b91c28009516fbf9881c5, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ac527702920deb5385f032a43f483e6, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8f501efca2d0ca55f6f916f2d47a8fea, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e972c2f201c4cc45e0bbe50dc31666ec, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=93215024d230adf395c90171b41a1e8d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6896c72887e9953363d11833443458e, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c3500c833234e63fb20f7bc4d6252f3, ASSIGN}] 2023-02-16 14:01:03,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b89a06ea80b91c28009516fbf9881c5, ASSIGN 2023-02-16 14:01:03,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=42bf7bcdd8d45fbbec523f50ebc1b333, ASSIGN 2023-02-16 14:01:03,977 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5972a40aaf60a8fdee56ec1a9d05f7f9, ASSIGN 2023-02-16 14:01:03,977 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b5eece579c05abd7b46ca8eef60dcb5e, ASSIGN 2023-02-16 14:01:03,978 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6b89a06ea80b91c28009516fbf9881c5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,978 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5972a40aaf60a8fdee56ec1a9d05f7f9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45629,1676556062276; forceNewPlan=false, retain=false 2023-02-16 14:01:03,978 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b5eece579c05abd7b46ca8eef60dcb5e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=42bf7bcdd8d45fbbec523f50ebc1b333, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45629,1676556062276; forceNewPlan=false, retain=false 2023-02-16 14:01:03,978 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c3500c833234e63fb20f7bc4d6252f3, ASSIGN 2023-02-16 14:01:03,979 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e972c2f201c4cc45e0bbe50dc31666ec, ASSIGN 2023-02-16 14:01:03,979 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=93215024d230adf395c90171b41a1e8d, ASSIGN 2023-02-16 14:01:03,979 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6896c72887e9953363d11833443458e, ASSIGN 2023-02-16 14:01:03,980 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8f501efca2d0ca55f6f916f2d47a8fea, ASSIGN 2023-02-16 14:01:03,979 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9c3500c833234e63fb20f7bc4d6252f3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,980 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e972c2f201c4cc45e0bbe50dc31666ec, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45629,1676556062276; forceNewPlan=false, retain=false 2023-02-16 14:01:03,981 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8f501efca2d0ca55f6f916f2d47a8fea, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,981 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ac527702920deb5385f032a43f483e6, ASSIGN 2023-02-16 14:01:03,981 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=93215024d230adf395c90171b41a1e8d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42653,1676556062311; forceNewPlan=false, retain=false 2023-02-16 14:01:03,981 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f6896c72887e9953363d11833443458e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45629,1676556062276; forceNewPlan=false, retain=false 2023-02-16 14:01:03,982 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4ac527702920deb5385f032a43f483e6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45629,1676556062276; forceNewPlan=false, retain=false 2023-02-16 14:01:04,128 INFO [jenkins-hbase20:44339] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 14:01:04,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e972c2f201c4cc45e0bbe50dc31666ec, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4ac527702920deb5385f032a43f483e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,133 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5972a40aaf60a8fdee56ec1a9d05f7f9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f6896c72887e9953363d11833443458e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064133"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064133"}]},"ts":"1676556064133"} 2023-02-16 14:01:04,133 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=42bf7bcdd8d45fbbec523f50ebc1b333, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,133 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064133"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064133"}]},"ts":"1676556064133"} 2023-02-16 14:01:04,133 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064133"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064133"}]},"ts":"1676556064133"} 2023-02-16 14:01:04,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064133"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064133"}]},"ts":"1676556064133"} 2023-02-16 14:01:04,133 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064133"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064133"}]},"ts":"1676556064133"} 2023-02-16 14:01:04,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure 4ac527702920deb5385f032a43f483e6, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:04,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure f6896c72887e9953363d11833443458e, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:04,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 5972a40aaf60a8fdee56ec1a9d05f7f9, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:04,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure e972c2f201c4cc45e0bbe50dc31666ec, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:04,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 42bf7bcdd8d45fbbec523f50ebc1b333, server=jenkins-hbase20.apache.org,45629,1676556062276}] 2023-02-16 14:01:04,142 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b5eece579c05abd7b46ca8eef60dcb5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,143 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556064142"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064142"}]},"ts":"1676556064142"} 2023-02-16 14:01:04,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=93215024d230adf395c90171b41a1e8d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8f501efca2d0ca55f6f916f2d47a8fea, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064143"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064143"}]},"ts":"1676556064143"} 2023-02-16 14:01:04,143 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6b89a06ea80b91c28009516fbf9881c5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064143"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064143"}]},"ts":"1676556064143"} 2023-02-16 14:01:04,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064143"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064143"}]},"ts":"1676556064143"} 2023-02-16 14:01:04,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9c3500c833234e63fb20f7bc4d6252f3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556064144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556064144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556064144"}]},"ts":"1676556064144"} 2023-02-16 14:01:04,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure b5eece579c05abd7b46ca8eef60dcb5e, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:04,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 93215024d230adf395c90171b41a1e8d, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:04,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 6b89a06ea80b91c28009516fbf9881c5, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:04,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure 8f501efca2d0ca55f6f916f2d47a8fea, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:04,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 9c3500c833234e63fb20f7bc4d6252f3, server=jenkins-hbase20.apache.org,42653,1676556062311}] 2023-02-16 14:01:04,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:04,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:04,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e972c2f201c4cc45e0bbe50dc31666ec, NAME => 'testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 14:01:04,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,294 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,295 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1 2023-02-16 14:01:04,295 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1 2023-02-16 14:01:04,296 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e972c2f201c4cc45e0bbe50dc31666ec columnFamilyName f1 2023-02-16 14:01:04,296 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(310): Store=e972c2f201c4cc45e0bbe50dc31666ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,296 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,298 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2 2023-02-16 14:01:04,298 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2 2023-02-16 14:01:04,298 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e972c2f201c4cc45e0bbe50dc31666ec columnFamilyName f2 2023-02-16 14:01:04,299 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(310): Store=e972c2f201c4cc45e0bbe50dc31666ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:04,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e972c2f201c4cc45e0bbe50dc31666ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74380050, jitterRate=0.10834911465644836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:04,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec., pid=24, masterSystemTime=1676556064289 2023-02-16 14:01:04,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b5eece579c05abd7b46ca8eef60dcb5e, NAME => 'testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 14:01:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 42bf7bcdd8d45fbbec523f50ebc1b333, NAME => 'testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 14:01:04,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e972c2f201c4cc45e0bbe50dc31666ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064308"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064308"}]},"ts":"1676556064308"} 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,309 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,309 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,310 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f1 2023-02-16 14:01:04,310 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1 2023-02-16 14:01:04,310 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f1 2023-02-16 14:01:04,310 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1 2023-02-16 14:01:04,311 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42bf7bcdd8d45fbbec523f50ebc1b333 columnFamilyName f1 2023-02-16 14:01:04,311 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5eece579c05abd7b46ca8eef60dcb5e columnFamilyName f1 2023-02-16 14:01:04,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-16 14:01:04,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure e972c2f201c4cc45e0bbe50dc31666ec, server=jenkins-hbase20.apache.org,45629,1676556062276 in 172 msec 2023-02-16 14:01:04,312 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(310): Store=42bf7bcdd8d45fbbec523f50ebc1b333/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,312 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,312 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(310): Store=b5eece579c05abd7b46ca8eef60dcb5e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,312 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e972c2f201c4cc45e0bbe50dc31666ec, ASSIGN in 337 msec 2023-02-16 14:01:04,314 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2 2023-02-16 14:01:04,314 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2 2023-02-16 14:01:04,314 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f2 2023-02-16 14:01:04,314 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f2 2023-02-16 14:01:04,314 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5eece579c05abd7b46ca8eef60dcb5e columnFamilyName f2 2023-02-16 14:01:04,314 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42bf7bcdd8d45fbbec523f50ebc1b333 columnFamilyName f2 2023-02-16 14:01:04,315 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(310): Store=42bf7bcdd8d45fbbec523f50ebc1b333/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,315 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(310): Store=b5eece579c05abd7b46ca8eef60dcb5e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:04,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b5eece579c05abd7b46ca8eef60dcb5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58815553, jitterRate=-0.1235799640417099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:04,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e., pid=26, masterSystemTime=1676556064304 2023-02-16 14:01:04,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 42bf7bcdd8d45fbbec523f50ebc1b333; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64319112, jitterRate=-0.04157054424285889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:04,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333., pid=25, masterSystemTime=1676556064289 2023-02-16 14:01:04,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93215024d230adf395c90171b41a1e8d, NAME => 'testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 14:01:04,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b5eece579c05abd7b46ca8eef60dcb5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,323 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556064323"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064323"}]},"ts":"1676556064323"} 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:04,323 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=42bf7bcdd8d45fbbec523f50ebc1b333, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ac527702920deb5385f032a43f483e6, NAME => 'testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 14:01:04,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064323"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064323"}]},"ts":"1676556064323"} 2023-02-16 14:01:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,325 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,325 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-16 14:01:04,326 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1 2023-02-16 14:01:04,326 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1 2023-02-16 14:01:04,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure b5eece579c05abd7b46ca8eef60dcb5e, server=jenkins-hbase20.apache.org,42653,1676556062311 in 180 msec 2023-02-16 14:01:04,327 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93215024d230adf395c90171b41a1e8d columnFamilyName f1 2023-02-16 14:01:04,327 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1 2023-02-16 14:01:04,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-16 14:01:04,327 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1 2023-02-16 14:01:04,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 42bf7bcdd8d45fbbec523f50ebc1b333, server=jenkins-hbase20.apache.org,45629,1676556062276 in 186 msec 2023-02-16 14:01:04,327 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ac527702920deb5385f032a43f483e6 columnFamilyName f1 2023-02-16 14:01:04,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b5eece579c05abd7b46ca8eef60dcb5e, ASSIGN in 353 msec 2023-02-16 14:01:04,327 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(310): Store=93215024d230adf395c90171b41a1e8d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,328 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=42bf7bcdd8d45fbbec523f50ebc1b333, ASSIGN in 353 msec 2023-02-16 14:01:04,328 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(310): Store=4ac527702920deb5385f032a43f483e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,328 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,329 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2 2023-02-16 14:01:04,329 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2 2023-02-16 14:01:04,329 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2 2023-02-16 14:01:04,329 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2 2023-02-16 14:01:04,329 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93215024d230adf395c90171b41a1e8d columnFamilyName f2 2023-02-16 14:01:04,329 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ac527702920deb5385f032a43f483e6 columnFamilyName f2 2023-02-16 14:01:04,330 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(310): Store=93215024d230adf395c90171b41a1e8d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,330 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(310): Store=4ac527702920deb5385f032a43f483e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:04,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:04,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 93215024d230adf395c90171b41a1e8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74363354, jitterRate=0.10810032486915588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d., pid=27, masterSystemTime=1676556064304 2023-02-16 14:01:04,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4ac527702920deb5385f032a43f483e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70448677, jitterRate=0.04976709187030792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:04,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6., pid=21, masterSystemTime=1676556064289 2023-02-16 14:01:04,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:04,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:04,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:04,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f501efca2d0ca55f6f916f2d47a8fea, NAME => 'testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 14:01:04,342 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=93215024d230adf395c90171b41a1e8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,342 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064342"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064342"}]},"ts":"1676556064342"} 2023-02-16 14:01:04,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:04,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:04,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:04,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6896c72887e9953363d11833443458e, NAME => 'testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4ac527702920deb5385f032a43f483e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064342"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064342"}]},"ts":"1676556064342"} 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,344 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-16 14:01:04,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 93215024d230adf395c90171b41a1e8d, server=jenkins-hbase20.apache.org,42653,1676556062311 in 196 msec 2023-02-16 14:01:04,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-16 14:01:04,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure 4ac527702920deb5385f032a43f483e6, server=jenkins-hbase20.apache.org,45629,1676556062276 in 210 msec 2023-02-16 14:01:04,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=93215024d230adf395c90171b41a1e8d, ASSIGN in 372 msec 2023-02-16 14:01:04,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ac527702920deb5385f032a43f483e6, ASSIGN in 372 msec 2023-02-16 14:01:04,351 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,352 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1 2023-02-16 14:01:04,352 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1 2023-02-16 14:01:04,352 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1 2023-02-16 14:01:04,352 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1 2023-02-16 14:01:04,352 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f501efca2d0ca55f6f916f2d47a8fea columnFamilyName f1 2023-02-16 14:01:04,352 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6896c72887e9953363d11833443458e columnFamilyName f1 2023-02-16 14:01:04,353 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(310): Store=f6896c72887e9953363d11833443458e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,353 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,353 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(310): Store=8f501efca2d0ca55f6f916f2d47a8fea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,354 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,355 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2 2023-02-16 14:01:04,355 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2 2023-02-16 14:01:04,355 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2 2023-02-16 14:01:04,355 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2 2023-02-16 14:01:04,355 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6896c72887e9953363d11833443458e columnFamilyName f2 2023-02-16 14:01:04,355 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f501efca2d0ca55f6f916f2d47a8fea columnFamilyName f2 2023-02-16 14:01:04,359 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(310): Store=8f501efca2d0ca55f6f916f2d47a8fea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,359 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(310): Store=f6896c72887e9953363d11833443458e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f6896c72887e9953363d11833443458e 2023-02-16 14:01:04,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:04,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8f501efca2d0ca55f6f916f2d47a8fea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72011169, jitterRate=0.07305003702640533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:04,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f6896c72887e9953363d11833443458e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60287614, jitterRate=-0.10164454579353333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:04,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea., pid=29, masterSystemTime=1676556064304 2023-02-16 14:01:04,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e., pid=22, masterSystemTime=1676556064289 2023-02-16 14:01:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:04,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:04,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:04,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8f501efca2d0ca55f6f916f2d47a8fea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b89a06ea80b91c28009516fbf9881c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 14:01:04,369 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064368"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064368"}]},"ts":"1676556064368"} 2023-02-16 14:01:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:04,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:04,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5972a40aaf60a8fdee56ec1a9d05f7f9, NAME => 'testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 14:01:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,370 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f6896c72887e9953363d11833443458e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,371 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064370"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064370"}]},"ts":"1676556064370"} 2023-02-16 14:01:04,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-16 14:01:04,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure 8f501efca2d0ca55f6f916f2d47a8fea, server=jenkins-hbase20.apache.org,42653,1676556062311 in 223 msec 2023-02-16 14:01:04,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-16 14:01:04,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure f6896c72887e9953363d11833443458e, server=jenkins-hbase20.apache.org,45629,1676556062276 in 237 msec 2023-02-16 14:01:04,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8f501efca2d0ca55f6f916f2d47a8fea, ASSIGN in 400 msec 2023-02-16 14:01:04,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f6896c72887e9953363d11833443458e, ASSIGN in 400 msec 2023-02-16 14:01:04,379 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,379 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,380 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1 2023-02-16 14:01:04,380 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1 2023-02-16 14:01:04,380 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1 2023-02-16 14:01:04,380 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1 2023-02-16 14:01:04,381 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b89a06ea80b91c28009516fbf9881c5 columnFamilyName f1 2023-02-16 14:01:04,381 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5972a40aaf60a8fdee56ec1a9d05f7f9 columnFamilyName f1 2023-02-16 14:01:04,381 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(310): Store=6b89a06ea80b91c28009516fbf9881c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,381 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(310): Store=5972a40aaf60a8fdee56ec1a9d05f7f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,381 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,381 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,382 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2 2023-02-16 14:01:04,382 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2 2023-02-16 14:01:04,382 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2 2023-02-16 14:01:04,382 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2 2023-02-16 14:01:04,382 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b89a06ea80b91c28009516fbf9881c5 columnFamilyName f2 2023-02-16 14:01:04,383 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5972a40aaf60a8fdee56ec1a9d05f7f9 columnFamilyName f2 2023-02-16 14:01:04,383 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(310): Store=5972a40aaf60a8fdee56ec1a9d05f7f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,383 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(310): Store=6b89a06ea80b91c28009516fbf9881c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:04,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:04,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5972a40aaf60a8fdee56ec1a9d05f7f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72799866, jitterRate=0.0848025381565094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:04,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9., pid=23, masterSystemTime=1676556064289 2023-02-16 14:01:04,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 6b89a06ea80b91c28009516fbf9881c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61412129, jitterRate=-0.08488796651363373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:04,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5., pid=28, masterSystemTime=1676556064304 2023-02-16 14:01:04,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:04,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:04,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5972a40aaf60a8fdee56ec1a9d05f7f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064392"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064392"}]},"ts":"1676556064392"} 2023-02-16 14:01:04,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:04,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:04,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:04,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c3500c833234e63fb20f7bc4d6252f3, NAME => 'testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 14:01:04,393 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6b89a06ea80b91c28009516fbf9881c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,393 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676556064393"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064393"}]},"ts":"1676556064393"} 2023-02-16 14:01:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-16 14:01:04,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 5972a40aaf60a8fdee56ec1a9d05f7f9, server=jenkins-hbase20.apache.org,45629,1676556062276 in 257 msec 2023-02-16 14:01:04,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5972a40aaf60a8fdee56ec1a9d05f7f9, ASSIGN in 423 msec 2023-02-16 14:01:04,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-16 14:01:04,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 6b89a06ea80b91c28009516fbf9881c5, server=jenkins-hbase20.apache.org,42653,1676556062311 in 246 msec 2023-02-16 14:01:04,397 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6b89a06ea80b91c28009516fbf9881c5, ASSIGN in 423 msec 2023-02-16 14:01:04,399 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f1 2023-02-16 14:01:04,399 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f1 2023-02-16 14:01:04,399 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3500c833234e63fb20f7bc4d6252f3 columnFamilyName f1 2023-02-16 14:01:04,400 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(310): Store=9c3500c833234e63fb20f7bc4d6252f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,400 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,401 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f2 2023-02-16 14:01:04,401 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f2 2023-02-16 14:01:04,401 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3500c833234e63fb20f7bc4d6252f3 columnFamilyName f2 2023-02-16 14:01:04,402 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(310): Store=9c3500c833234e63fb20f7bc4d6252f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:04,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:04,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9c3500c833234e63fb20f7bc4d6252f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74659624, jitterRate=0.11251509189605713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:04,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3., pid=30, masterSystemTime=1676556064304 2023-02-16 14:01:04,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:04,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:04,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9c3500c833234e63fb20f7bc4d6252f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676556064414"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556064414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556064414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556064414"}]},"ts":"1676556064414"} 2023-02-16 14:01:04,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-16 14:01:04,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 9c3500c833234e63fb20f7bc4d6252f3, server=jenkins-hbase20.apache.org,42653,1676556062311 in 265 msec 2023-02-16 14:01:04,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-16 14:01:04,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c3500c833234e63fb20f7bc4d6252f3, ASSIGN in 444 msec 2023-02-16 14:01:04,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:04,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556064421"}]},"ts":"1676556064421"} 2023-02-16 14:01:04,422 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 14:01:04,424 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:04,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 569 msec 2023-02-16 14:01:04,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:04,465 INFO [Listener at localhost.localdomain/35977] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 14:01:04,465 DEBUG [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 14:01:04,466 INFO [Listener at localhost.localdomain/35977] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:04,469 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 14:01:04,470 INFO [Listener at localhost.localdomain/35977] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:04,470 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 14:01:04,470 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:04,534 DEBUG [hconnection-0x1551380b-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:04,544 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:04,550 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:04,563 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45629] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:04,703 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:04,703 INFO [Listener at localhost.localdomain/35977] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:04,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:04,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556064706 (current time:1676556064706). 2023-02-16 14:01:04,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:04,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] zookeeper.ReadOnlyZKClient(139): Connect 0x10fe1fd4 to 127.0.0.1:55872 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:04,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25a1e3dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:04,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:04,733 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43288, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10fe1fd4 to 127.0.0.1:55872 2023-02-16 14:01:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:04,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:04,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:04,740 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:04,742 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676556664742 2023-02-16 14:01:04,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:04,743 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:04,743 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:04,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 14:01:04,745 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:04,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:04,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 8 msec 2023-02-16 14:01:04,746 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:04,748 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676556664748 2023-02-16 14:01:04,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,768 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-16 14:01:04,770 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:04,774 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-16 14:01:04,774 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-16 14:01:04,774 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,774 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,775 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:04,775 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:04,775 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:04,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:04,776 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,776 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,776 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,776 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:04,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,777 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 14:01:04,777 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:04,777 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 14:01:04,778 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 14:01:04,778 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 14:01:04,778 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:04,778 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42653,1676556062311' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 14:01:04,786 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,786 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,786 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:04,787 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 14:01:04,787 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 14:01:04,787 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45629,1676556062276' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 14:01:04,793 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:04,794 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,794 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:04,794 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,794 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42653,1676556062311' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75e6a48b[Count = 1] remaining members to acquire global barrier 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45629,1676556062276' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 14:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75e6a48b[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:04,798 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-16 14:01:04,798 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,799 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,799 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:04,799 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:04,799 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:04,800 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:04,800 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,803 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:04,803 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:04,803 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. started... 2023-02-16 14:01:04,803 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:04,803 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. started... 2023-02-16 14:01:04,804 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:04,809 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:04,805 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6b89a06ea80b91c28009516fbf9881c5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:04,811 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:01:04,811 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. started... 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. started... 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. started... 2023-02-16 14:01:04,811 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:04,814 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 93215024d230adf395c90171b41a1e8d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:04,813 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 42bf7bcdd8d45fbbec523f50ebc1b333 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:04,814 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e972c2f201c4cc45e0bbe50dc31666ec 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:04,811 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. started... 2023-02-16 14:01:04,816 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5972a40aaf60a8fdee56ec1a9d05f7f9 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:01:04,843 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:04,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:04,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:04,845 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:04,912 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f1/1863e729a29a43579960fe125b0c06dc 2023-02-16 14:01:04,921 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. completed. 2023-02-16 14:01:04,921 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:04,921 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:04,921 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. started... 2023-02-16 14:01:04,921 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:01:04,923 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:04,924 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:04,924 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:04,924 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:04,924 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:04,935 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f1/429faab0ca9f4b72a6f217bd007dae4a 2023-02-16 14:01:04,939 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f1/046223787af242fea033728cab521256 2023-02-16 14:01:04,940 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f1/8c8f52cb052b4f8db7f917e779f1b59c 2023-02-16 14:01:04,974 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f1/a9465b55702d4d7788a6cf274595a71f 2023-02-16 14:01:04,988 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f2/7f0bec027e704260a2abb2ab913ed297 2023-02-16 14:01:04,989 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. completed. 2023-02-16 14:01:04,989 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:04,989 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:04,989 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:01:04,989 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. started... 2023-02-16 14:01:04,990 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8f501efca2d0ca55f6f916f2d47a8fea 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:05,017 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f1/1863e729a29a43579960fe125b0c06dc as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/1863e729a29a43579960fe125b0c06dc 2023-02-16 14:01:05,022 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/1863e729a29a43579960fe125b0c06dc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,023 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f2/7f0bec027e704260a2abb2ab913ed297 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/7f0bec027e704260a2abb2ab913ed297 2023-02-16 14:01:05,029 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/7f0bec027e704260a2abb2ab913ed297, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,030 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e972c2f201c4cc45e0bbe50dc31666ec in 217ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,030 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 14:01:05,030 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:05,030 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,030 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,031 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/1863e729a29a43579960fe125b0c06dc] hfiles 2023-02-16 14:01:05,031 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/1863e729a29a43579960fe125b0c06dc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,031 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/7f0bec027e704260a2abb2ab913ed297] hfiles 2023-02-16 14:01:05,031 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/7f0bec027e704260a2abb2ab913ed297 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,046 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:05,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:05,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:05,048 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 14:01:05,055 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f2/fb9fa4e3ab1e484390f34a6c7718954d 2023-02-16 14:01:05,065 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f2/60a24b2666284033822d9c243243144e 2023-02-16 14:01:05,105 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f2/b1ce689284ce419b930291a1226f4689 2023-02-16 14:01:05,105 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f1/586b3e113bb04dfa9e18dd6fe5bb4667 2023-02-16 14:01:05,106 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f1/429faab0ca9f4b72a6f217bd007dae4a as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/429faab0ca9f4b72a6f217bd007dae4a 2023-02-16 14:01:05,109 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. completed. 2023-02-16 14:01:05,109 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:05,109 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:05,109 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:01:05,109 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. started... 2023-02-16 14:01:05,110 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4ac527702920deb5385f032a43f483e6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:05,112 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f1/046223787af242fea033728cab521256 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/046223787af242fea033728cab521256 2023-02-16 14:01:05,120 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/429faab0ca9f4b72a6f217bd007dae4a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,121 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f1/a9465b55702d4d7788a6cf274595a71f as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/a9465b55702d4d7788a6cf274595a71f 2023-02-16 14:01:05,121 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f2/fb9fa4e3ab1e484390f34a6c7718954d as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/fb9fa4e3ab1e484390f34a6c7718954d 2023-02-16 14:01:05,187 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/046223787af242fea033728cab521256, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:05,188 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/fb9fa4e3ab1e484390f34a6c7718954d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,189 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 93215024d230adf395c90171b41a1e8d in 375ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,192 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f2/60a24b2666284033822d9c243243144e as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/60a24b2666284033822d9c243243144e 2023-02-16 14:01:05,194 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/a9465b55702d4d7788a6cf274595a71f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,197 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f2/b1ce689284ce419b930291a1226f4689 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/b1ce689284ce419b930291a1226f4689 2023-02-16 14:01:05,208 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:05,208 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,208 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,208 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/429faab0ca9f4b72a6f217bd007dae4a] hfiles 2023-02-16 14:01:05,209 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/429faab0ca9f4b72a6f217bd007dae4a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,209 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/fb9fa4e3ab1e484390f34a6c7718954d] hfiles 2023-02-16 14:01:05,209 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/fb9fa4e3ab1e484390f34a6c7718954d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,231 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/60a24b2666284033822d9c243243144e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:05,232 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5972a40aaf60a8fdee56ec1a9d05f7f9 in 416ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/046223787af242fea033728cab521256] hfiles 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/046223787af242fea033728cab521256 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/60a24b2666284033822d9c243243144e] hfiles 2023-02-16 14:01:05,232 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/60a24b2666284033822d9c243243144e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,236 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/b1ce689284ce419b930291a1226f4689, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,237 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6b89a06ea80b91c28009516fbf9881c5 in 432ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,237 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/a9465b55702d4d7788a6cf274595a71f] hfiles 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/a9465b55702d4d7788a6cf274595a71f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/b1ce689284ce419b930291a1226f4689] hfiles 2023-02-16 14:01:05,238 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/b1ce689284ce419b930291a1226f4689 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,239 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f1/d0ba6e54fb524a9fb41febbe775dddb8 2023-02-16 14:01:05,275 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:05,302 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f2/9c3ae0e7fe24445e989b0791d0332b9f 2023-02-16 14:01:05,320 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f1/586b3e113bb04dfa9e18dd6fe5bb4667 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/586b3e113bb04dfa9e18dd6fe5bb4667 2023-02-16 14:01:05,320 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. completed. 2023-02-16 14:01:05,320 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:05,320 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:01:05,335 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. completed. 2023-02-16 14:01:05,335 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:05,335 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:05,335 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:01:05,335 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. started... 2023-02-16 14:01:05,335 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f6896c72887e9953363d11833443458e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:01:05,350 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:05,351 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/586b3e113bb04dfa9e18dd6fe5bb4667, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:05,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:05,352 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 14:01:05,363 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f2/9c3ae0e7fe24445e989b0791d0332b9f as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/9c3ae0e7fe24445e989b0791d0332b9f 2023-02-16 14:01:05,374 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/9c3ae0e7fe24445e989b0791d0332b9f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,376 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f2/ca1db71b439e4aee8ef4c2656c53f823 2023-02-16 14:01:05,381 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8f501efca2d0ca55f6f916f2d47a8fea in 391ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,381 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:05,381 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,382 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,382 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/586b3e113bb04dfa9e18dd6fe5bb4667] hfiles 2023-02-16 14:01:05,382 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/586b3e113bb04dfa9e18dd6fe5bb4667 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,382 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/9c3ae0e7fe24445e989b0791d0332b9f] hfiles 2023-02-16 14:01:05,382 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/9c3ae0e7fe24445e989b0791d0332b9f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,386 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f1/d0ba6e54fb524a9fb41febbe775dddb8 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/d0ba6e54fb524a9fb41febbe775dddb8 2023-02-16 14:01:05,396 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f1/1d06359a6ff142639e94fe72523ad901 2023-02-16 14:01:05,396 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/d0ba6e54fb524a9fb41febbe775dddb8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,398 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f2/ca1db71b439e4aee8ef4c2656c53f823 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/ca1db71b439e4aee8ef4c2656c53f823 2023-02-16 14:01:05,408 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/ca1db71b439e4aee8ef4c2656c53f823, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,409 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4ac527702920deb5385f032a43f483e6 in 300ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,409 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:05,409 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,409 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,409 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/d0ba6e54fb524a9fb41febbe775dddb8] hfiles 2023-02-16 14:01:05,410 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/d0ba6e54fb524a9fb41febbe775dddb8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,410 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/ca1db71b439e4aee8ef4c2656c53f823] hfiles 2023-02-16 14:01:05,410 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/ca1db71b439e4aee8ef4c2656c53f823 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,427 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. completed. 2023-02-16 14:01:05,427 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:05,427 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:01:05,433 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f2/b0525b1f52944d0b9edd65780e412e83 2023-02-16 14:01:05,435 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. completed. 2023-02-16 14:01:05,435 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:05,435 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:01:05,444 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f1/1d06359a6ff142639e94fe72523ad901 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/1d06359a6ff142639e94fe72523ad901 2023-02-16 14:01:05,451 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/1d06359a6ff142639e94fe72523ad901, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:05,452 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f2/b0525b1f52944d0b9edd65780e412e83 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/b0525b1f52944d0b9edd65780e412e83 2023-02-16 14:01:05,458 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/b0525b1f52944d0b9edd65780e412e83, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:05,459 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f6896c72887e9953363d11833443458e in 124ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/1d06359a6ff142639e94fe72523ad901] hfiles 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/1d06359a6ff142639e94fe72523ad901 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/b0525b1f52944d0b9edd65780e412e83] hfiles 2023-02-16 14:01:05,459 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/b0525b1f52944d0b9edd65780e412e83 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,469 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. completed. 2023-02-16 14:01:05,469 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:05,469 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:01:05,505 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f2/782efaea64dc4d909ca084122dca8c05 2023-02-16 14:01:05,512 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f1/8c8f52cb052b4f8db7f917e779f1b59c as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/8c8f52cb052b4f8db7f917e779f1b59c 2023-02-16 14:01:05,520 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/8c8f52cb052b4f8db7f917e779f1b59c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,522 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f2/782efaea64dc4d909ca084122dca8c05 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/782efaea64dc4d909ca084122dca8c05 2023-02-16 14:01:05,529 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/782efaea64dc4d909ca084122dca8c05, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:05,530 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 42bf7bcdd8d45fbbec523f50ebc1b333 in 718ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/8c8f52cb052b4f8db7f917e779f1b59c] hfiles 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/8c8f52cb052b4f8db7f917e779f1b59c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/782efaea64dc4d909ca084122dca8c05] hfiles 2023-02-16 14:01:05,530 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/782efaea64dc4d909ca084122dca8c05 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,536 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. completed. 2023-02-16 14:01:05,536 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:01:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:01:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,537 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 14:01:05,537 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,45629,1676556062276' in zk 2023-02-16 14:01:05,538 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,538 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 14:01:05,538 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:05,538 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 14:01:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,45629,1676556062276': 2023-02-16 14:01:05,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45629,1676556062276' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 14:01:05,671 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. completed. 2023-02-16 14:01:05,671 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:01:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:01:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 14:01:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,42653,1676556062311' in zk 2023-02-16 14:01:05,674 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 14:01:05,674 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,674 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:05,674 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 14:01:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:05,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,42653,1676556062311': 2023-02-16 14:01:05,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42653,1676556062311' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:05,684 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-16 14:01:05,684 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:05,684 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:05,684 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,685 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:05,687 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:05,687 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:05,687 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:05,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,687 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:05,687 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:05,688 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,689 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,690 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,693 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,693 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:05,694 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:05,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:05,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:05,694 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:05,693 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,694 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:05,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,694 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,694 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:05,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:05,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,695 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:05,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-16 14:01:05,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,747 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:05,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676556064743Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676556065695 (+952 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676556065695Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676556065701 (+6 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676556065710 (+9 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676556065747 (+37 ms) 2023-02-16 14:01:05,749 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:05,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0050 sec 2023-02-16 14:01:05,852 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:05,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:05,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:05,854 INFO [Listener at localhost.localdomain/35977] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:06,044 INFO [Listener at localhost.localdomain/35977] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:06,055 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:06,092 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:06,103 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45629] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:06,196 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:06,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:06,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 14:01:06,207 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 14:01:06,207 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:06,208 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 14:01:06,208 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 14:01:06,208 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,208 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,209 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:06,209 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:06,209 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:06,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:06,210 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,210 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,210 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,210 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:06,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:01:06,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:01:06,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:01:06,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:01:06,219 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:01:06,219 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:01:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:01:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:01:06,226 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:06,224 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:06,226 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. started... 2023-02-16 14:01:06,226 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. started... 2023-02-16 14:01:06,226 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e972c2f201c4cc45e0bbe50dc31666ec 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,226 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 42bf7bcdd8d45fbbec523f50ebc1b333 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,231 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:06,234 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:06,234 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. started... 2023-02-16 14:01:06,234 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:01:06,234 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:06,232 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:06,234 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. started... 2023-02-16 14:01:06,235 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5972a40aaf60a8fdee56ec1a9d05f7f9 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:01:06,235 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6b89a06ea80b91c28009516fbf9881c5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,235 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. started... 2023-02-16 14:01:06,235 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:06,235 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:06,239 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:01:06,239 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:06,239 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. started... 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. started... 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:06,239 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 93215024d230adf395c90171b41a1e8d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:06,239 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:06,239 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. started... 2023-02-16 14:01:06,240 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f501efca2d0ca55f6f916f2d47a8fea 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,320 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f1/a0980c612577431aa8fe4f79096acedb 2023-02-16 14:01:06,323 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f1/06492a4dcf724a728166062a6e22f17c 2023-02-16 14:01:06,323 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f1/36f062c90f0e477485c302894e1a2e32 2023-02-16 14:01:06,335 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f1/4829eccc4288409daf47d826b64b019c 2023-02-16 14:01:06,358 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f1/afa9d9382019477394bbd175a62603a8 2023-02-16 14:01:06,384 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f1/514a63ff9b4a44cc81ce655fb920f9de 2023-02-16 14:01:06,415 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f2/d04d6bb1b07449f8bc6cff7c7f4a6195 2023-02-16 14:01:06,422 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f1/06492a4dcf724a728166062a6e22f17c as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/06492a4dcf724a728166062a6e22f17c 2023-02-16 14:01:06,423 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f2/2607b4e7b5064dbfb27f0c327181d607 2023-02-16 14:01:06,430 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/06492a4dcf724a728166062a6e22f17c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,431 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f1/36f062c90f0e477485c302894e1a2e32 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/36f062c90f0e477485c302894e1a2e32 2023-02-16 14:01:06,431 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/.tmp/f2/d04d6bb1b07449f8bc6cff7c7f4a6195 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/d04d6bb1b07449f8bc6cff7c7f4a6195 2023-02-16 14:01:06,438 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/36f062c90f0e477485c302894e1a2e32, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,439 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/d04d6bb1b07449f8bc6cff7c7f4a6195, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,440 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/.tmp/f2/2607b4e7b5064dbfb27f0c327181d607 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/2607b4e7b5064dbfb27f0c327181d607 2023-02-16 14:01:06,441 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e972c2f201c4cc45e0bbe50dc31666ec in 215ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:06,445 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f2/ca7af04b1d924318bba64033a05b79c9 2023-02-16 14:01:06,445 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:01:06,445 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:06,446 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. started... 2023-02-16 14:01:06,446 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4ac527702920deb5385f032a43f483e6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:06,454 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/2607b4e7b5064dbfb27f0c327181d607, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,455 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6b89a06ea80b91c28009516fbf9881c5 in 221ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,455 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:06,455 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:06,455 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:01:06,457 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f1/a0980c612577431aa8fe4f79096acedb as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/a0980c612577431aa8fe4f79096acedb 2023-02-16 14:01:06,459 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f2/9b90f96251784678acdd479e9805f642 2023-02-16 14:01:06,463 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f2/8f1840b9961d4ba7a6e683cda27b250b 2023-02-16 14:01:06,464 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/a0980c612577431aa8fe4f79096acedb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:06,464 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f1/4829eccc4288409daf47d826b64b019c as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/4829eccc4288409daf47d826b64b019c 2023-02-16 14:01:06,465 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/.tmp/f2/ca7af04b1d924318bba64033a05b79c9 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/ca7af04b1d924318bba64033a05b79c9 2023-02-16 14:01:06,474 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f1/afa9d9382019477394bbd175a62603a8 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/afa9d9382019477394bbd175a62603a8 2023-02-16 14:01:06,478 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/4829eccc4288409daf47d826b64b019c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,480 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/.tmp/f2/9b90f96251784678acdd479e9805f642 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/9b90f96251784678acdd479e9805f642 2023-02-16 14:01:06,480 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/ca7af04b1d924318bba64033a05b79c9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:06,481 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5972a40aaf60a8fdee56ec1a9d05f7f9 in 246ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,482 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:06,482 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:06,482 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:06,482 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:01:06,482 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. started... 2023-02-16 14:01:06,482 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f6896c72887e9953363d11833443458e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:01:06,487 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f2/1038815363fb4527bc02397ea2a55841 2023-02-16 14:01:06,492 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/9b90f96251784678acdd479e9805f642, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,493 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f1/514a63ff9b4a44cc81ce655fb920f9de as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/514a63ff9b4a44cc81ce655fb920f9de 2023-02-16 14:01:06,494 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 42bf7bcdd8d45fbbec523f50ebc1b333 in 268ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,494 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:06,494 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:06,494 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:01:06,494 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/afa9d9382019477394bbd175a62603a8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,495 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/.tmp/f2/8f1840b9961d4ba7a6e683cda27b250b as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/8f1840b9961d4ba7a6e683cda27b250b 2023-02-16 14:01:06,499 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/514a63ff9b4a44cc81ce655fb920f9de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,500 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/.tmp/f2/1038815363fb4527bc02397ea2a55841 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/1038815363fb4527bc02397ea2a55841 2023-02-16 14:01:06,500 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/8f1840b9961d4ba7a6e683cda27b250b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,501 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 93215024d230adf395c90171b41a1e8d in 262ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,501 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:06,501 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:06,502 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:01:06,507 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f1/8e9657b1cc484eadafc5897301b5c60f 2023-02-16 14:01:06,513 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/1038815363fb4527bc02397ea2a55841, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,514 INFO [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8f501efca2d0ca55f6f916f2d47a8fea in 274ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,514 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:06,514 DEBUG [rs(jenkins-hbase20.apache.org,42653,1676556062311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:06,514 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:01:06,515 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:01:06,515 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,515 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:01:06,515 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42653,1676556062311' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:01:06,516 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,516 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:06,516 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,516 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:06,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42653,1676556062311' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 14:01:06,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d92eef[Count = 1] remaining members to acquire global barrier 2023-02-16 14:01:06,537 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f2/66e389ccc57f43aa8f3dd840ccdc8158 2023-02-16 14:01:06,542 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f1/8e9657b1cc484eadafc5897301b5c60f as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/8e9657b1cc484eadafc5897301b5c60f 2023-02-16 14:01:06,547 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/8e9657b1cc484eadafc5897301b5c60f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,548 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/.tmp/f2/66e389ccc57f43aa8f3dd840ccdc8158 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/66e389ccc57f43aa8f3dd840ccdc8158 2023-02-16 14:01:06,553 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/66e389ccc57f43aa8f3dd840ccdc8158, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:06,553 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4ac527702920deb5385f032a43f483e6 in 107ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,553 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:06,554 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:06,554 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:01:06,922 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f1/13565dcfd6ba4289a3150304cae61ba8 2023-02-16 14:01:06,940 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f2/2c8fefa06c67447abd56f9aef6813055 2023-02-16 14:01:06,946 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f1/13565dcfd6ba4289a3150304cae61ba8 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/13565dcfd6ba4289a3150304cae61ba8 2023-02-16 14:01:06,952 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/13565dcfd6ba4289a3150304cae61ba8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:06,953 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/.tmp/f2/2c8fefa06c67447abd56f9aef6813055 as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/2c8fefa06c67447abd56f9aef6813055 2023-02-16 14:01:06,958 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/2c8fefa06c67447abd56f9aef6813055, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:06,958 INFO [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f6896c72887e9953363d11833443458e in 476ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:06,958 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:06,958 DEBUG [rs(jenkins-hbase20.apache.org,45629,1676556062276)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:06,959 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:01:06,959 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:01:06,959 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,959 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:01:06,959 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45629,1676556062276' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:01:06,960 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,960 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:06,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:06,960 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,960 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:06,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:06,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:06,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:06,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45629,1676556062276' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 14:01:06,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d92eef[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:06,962 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 14:01:06,962 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,963 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,963 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:01:06,964 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,42653,1676556062311' in zk 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:01:06,964 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,45629,1676556062276' in zk 2023-02-16 14:01:06,964 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,964 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:06,965 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:01:06,965 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,965 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:06,965 DEBUG [member: 'jenkins-hbase20.apache.org,42653,1676556062311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:01:06,968 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:01:06,968 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,968 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:06,968 DEBUG [member: 'jenkins-hbase20.apache.org,45629,1676556062276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:01:06,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:06,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:06,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:06,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:06,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,42653,1676556062311': 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42653,1676556062311' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 14:01:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,45629,1676556062276': 2023-02-16 14:01:06,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45629,1676556062276' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 14:01:06,975 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 14:01:06,975 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:06,975 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:06,975 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 14:01:06,975 INFO [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:06,977 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,977 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,977 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:06,977 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:06,977 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:06,978 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:06,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,979 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,980 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,980 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,986 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,986 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,986 DEBUG [(jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:06,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 14:01:06,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:06,986 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:06,986 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:06,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:06,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:06,988 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:06,987 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:06,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:06,988 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,988 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:06,988 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:06,988 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:06,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:07,088 DEBUG [Listener at localhost.localdomain/35977] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:07,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:07,090 INFO [Listener at localhost.localdomain/35977] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:07,090 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f29c90d to 127.0.0.1:55872 2023-02-16 14:01:07,090 DEBUG [Listener at localhost.localdomain/35977] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,091 DEBUG [Listener at localhost.localdomain/35977] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:07,091 DEBUG [Listener at localhost.localdomain/35977] util.JVMClusterUtil(257): Found active master hash=668987851, stopped=false 2023-02-16 14:01:07,091 INFO [Listener at localhost.localdomain/35977] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:07,092 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:07,092 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:07,092 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:07,092 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:07,092 INFO [Listener at localhost.localdomain/35977] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:07,093 DEBUG [Listener at localhost.localdomain/35977] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c57e710 to 127.0.0.1:55872 2023-02-16 14:01:07,094 DEBUG [Listener at localhost.localdomain/35977] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:07,094 INFO [Listener at localhost.localdomain/35977] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,45629,1676556062276' ***** 2023-02-16 14:01:07,094 INFO [Listener at localhost.localdomain/35977] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:07,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:07,094 INFO [RS:0;jenkins-hbase20:45629] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:07,094 INFO [RS:0;jenkins-hbase20:45629] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:07,094 INFO [RS:0;jenkins-hbase20:45629] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:07,094 INFO [Listener at localhost.localdomain/35977] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42653,1676556062311' ***** 2023-02-16 14:01:07,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:07,095 INFO [Listener at localhost.localdomain/35977] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:07,095 INFO [RS:1;jenkins-hbase20:42653] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:07,095 INFO [RS:1;jenkins-hbase20:42653] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:07,095 INFO [RS:1;jenkins-hbase20:42653] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:07,095 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:07,095 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:07,094 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:07,095 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:07,096 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for 07905a98381ed79d35a16983bc564c06 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 6b89a06ea80b91c28009516fbf9881c5, disabling compactions & flushes 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:07,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(3304): Received CLOSE for 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. after waiting 0 ms 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,097 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e972c2f201c4cc45e0bbe50dc31666ec, disabling compactions & flushes 2023-02-16 14:01:07,097 DEBUG [RS:1;jenkins-hbase20:42653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e37dcf4 to 127.0.0.1:55872 2023-02-16 14:01:07,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,097 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,097 DEBUG [RS:1;jenkins-hbase20:42653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. after waiting 0 ms 2023-02-16 14:01:07,097 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:07,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,097 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-16 14:01:07,099 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for f6896c72887e9953363d11833443458e 2023-02-16 14:01:07,100 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1479): Online Regions={6b89a06ea80b91c28009516fbf9881c5=testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5., b5eece579c05abd7b46ca8eef60dcb5e=testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e., 07905a98381ed79d35a16983bc564c06=hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06., 93215024d230adf395c90171b41a1e8d=testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d., 9c3500c833234e63fb20f7bc4d6252f3=testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3., 8f501efca2d0ca55f6f916f2d47a8fea=testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.} 2023-02-16 14:01:07,102 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:07,103 DEBUG [RS:0;jenkins-hbase20:45629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e86e1c to 127.0.0.1:55872 2023-02-16 14:01:07,103 DEBUG [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1505): Waiting on 07905a98381ed79d35a16983bc564c06, 6b89a06ea80b91c28009516fbf9881c5, 8f501efca2d0ca55f6f916f2d47a8fea, 93215024d230adf395c90171b41a1e8d, 9c3500c833234e63fb20f7bc4d6252f3, b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:07,104 DEBUG [RS:0;jenkins-hbase20:45629] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,106 INFO [RS:0;jenkins-hbase20:45629] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:07,106 INFO [RS:0;jenkins-hbase20:45629] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:07,106 INFO [RS:0;jenkins-hbase20:45629] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:07,106 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:07,106 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-16 14:01:07,106 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1479): Online Regions={e972c2f201c4cc45e0bbe50dc31666ec=testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec., 1588230740=hbase:meta,,1.1588230740, 42bf7bcdd8d45fbbec523f50ebc1b333=testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333., 5972a40aaf60a8fdee56ec1a9d05f7f9=testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9., 4ac527702920deb5385f032a43f483e6=testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6., f6896c72887e9953363d11833443458e=testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.} 2023-02-16 14:01:07,106 DEBUG [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1505): Waiting on 1588230740, 42bf7bcdd8d45fbbec523f50ebc1b333, 4ac527702920deb5385f032a43f483e6, 5972a40aaf60a8fdee56ec1a9d05f7f9, e972c2f201c4cc45e0bbe50dc31666ec, f6896c72887e9953363d11833443458e 2023-02-16 14:01:07,106 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:07,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:07,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:07,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:07,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:07,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.97 KB heapSize=23.05 KB 2023-02-16 14:01:07,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b5eece579c05abd7b46ca8eef60dcb5e, disabling compactions & flushes 2023-02-16 14:01:07,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. after waiting 0 ms 2023-02-16 14:01:07,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:07,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 42bf7bcdd8d45fbbec523f50ebc1b333, disabling compactions & flushes 2023-02-16 14:01:07,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. after waiting 0 ms 2023-02-16 14:01:07,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,138 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:07,139 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:07,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:01:07,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 07905a98381ed79d35a16983bc564c06, disabling compactions & flushes 2023-02-16 14:01:07,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. after waiting 0 ms 2023-02-16 14:01:07,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:07,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 07905a98381ed79d35a16983bc564c06 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:07,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5972a40aaf60a8fdee56ec1a9d05f7f9, disabling compactions & flushes 2023-02-16 14:01:07,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. after waiting 0 ms 2023-02-16 14:01:07,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:07,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.78 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/.tmp/info/1a2471783b61474e8eac4fae1d0ac5cc 2023-02-16 14:01:07,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/.tmp/info/960754dcbdd3431784551501d240ecec 2023-02-16 14:01:07,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:07,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:07,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4ac527702920deb5385f032a43f483e6, disabling compactions & flushes 2023-02-16 14:01:07,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. after waiting 0 ms 2023-02-16 14:01:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/.tmp/info/960754dcbdd3431784551501d240ecec as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/info/960754dcbdd3431784551501d240ecec 2023-02-16 14:01:07,184 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/.tmp/table/425cc4d00eaa4045ba6cc0dd7e80461d 2023-02-16 14:01:07,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/info/960754dcbdd3431784551501d240ecec, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:07,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:07,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f6896c72887e9953363d11833443458e, disabling compactions & flushes 2023-02-16 14:01:07,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:07,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:07,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 07905a98381ed79d35a16983bc564c06 in 47ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:07,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. after waiting 0 ms 2023-02-16 14:01:07,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 14:01:07,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:07,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/.tmp/info/1a2471783b61474e8eac4fae1d0ac5cc as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/info/1a2471783b61474e8eac4fae1d0ac5cc 2023-02-16 14:01:07,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/namespace/07905a98381ed79d35a16983bc564c06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:07,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:07,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 07905a98381ed79d35a16983bc564c06: 2023-02-16 14:01:07,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556062917.07905a98381ed79d35a16983bc564c06. 2023-02-16 14:01:07,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 93215024d230adf395c90171b41a1e8d, disabling compactions & flushes 2023-02-16 14:01:07,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. after waiting 0 ms 2023-02-16 14:01:07,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:07,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:07,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:07,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/info/1a2471783b61474e8eac4fae1d0ac5cc, entries=110, sequenceid=32, filesize=18.7 K 2023-02-16 14:01:07,211 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/.tmp/table/425cc4d00eaa4045ba6cc0dd7e80461d as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/table/425cc4d00eaa4045ba6cc0dd7e80461d 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9c3500c833234e63fb20f7bc4d6252f3, disabling compactions & flushes 2023-02-16 14:01:07,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. after waiting 0 ms 2023-02-16 14:01:07,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:01:07,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:07,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/table/425cc4d00eaa4045ba6cc0dd7e80461d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-16 14:01:07,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8f501efca2d0ca55f6f916f2d47a8fea, disabling compactions & flushes 2023-02-16 14:01:07,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. after waiting 0 ms 2023-02-16 14:01:07,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.97 KB/14302, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 108ms, sequenceid=32, compaction requested=false 2023-02-16 14:01:07,217 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 14:01:07,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:07,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:07,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-16 14:01:07,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:07,226 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:07,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:07,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:07,306 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42653,1676556062311; all regions closed. 2023-02-16 14:01:07,306 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,45629,1676556062276; all regions closed. 2023-02-16 14:01:07,316 DEBUG [RS:1;jenkins-hbase20:42653] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs 2023-02-16 14:01:07,316 DEBUG [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs 2023-02-16 14:01:07,316 INFO [RS:1;jenkins-hbase20:42653] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42653%2C1676556062311:(num 1676556063623) 2023-02-16 14:01:07,317 INFO [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C45629%2C1676556062276.meta:.meta(num 1676556062857) 2023-02-16 14:01:07,317 DEBUG [RS:1;jenkins-hbase20:42653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,317 INFO [RS:1;jenkins-hbase20:42653] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:07,317 INFO [RS:1;jenkins-hbase20:42653] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:07,317 INFO [RS:1;jenkins-hbase20:42653] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:07,317 INFO [RS:1;jenkins-hbase20:42653] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:07,317 INFO [RS:1;jenkins-hbase20:42653] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:07,317 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:07,318 INFO [RS:1;jenkins-hbase20:42653] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42653 2023-02-16 14:01:07,320 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:07,320 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42653,1676556062311 2023-02-16 14:01:07,321 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:07,321 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:07,321 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:07,321 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5789fe2a rejected from java.util.concurrent.ThreadPoolExecutor@53b66003[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,321 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42653,1676556062311] 2023-02-16 14:01:07,321 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42653,1676556062311; numProcessing=1 2023-02-16 14:01:07,322 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42653,1676556062311 already deleted, retry=false 2023-02-16 14:01:07,323 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42653,1676556062311 expired; onlineServers=1 2023-02-16 14:01:07,324 DEBUG [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/oldWALs 2023-02-16 14:01:07,324 INFO [RS:0;jenkins-hbase20:45629] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C45629%2C1676556062276:(num 1676556063623) 2023-02-16 14:01:07,324 DEBUG [RS:0;jenkins-hbase20:45629] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,325 INFO [RS:0;jenkins-hbase20:45629] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:07,325 INFO [RS:0;jenkins-hbase20:45629] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:07,325 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:07,326 INFO [RS:0;jenkins-hbase20:45629] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45629 2023-02-16 14:01:07,335 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45629,1676556062276 2023-02-16 14:01:07,335 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:07,335 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7456028b rejected from java.util.concurrent.ThreadPoolExecutor@706988d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,344 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,45629,1676556062276] 2023-02-16 14:01:07,344 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,45629,1676556062276; numProcessing=2 2023-02-16 14:01:07,351 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,45629,1676556062276 already deleted, retry=false 2023-02-16 14:01:07,352 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,45629,1676556062276 expired; onlineServers=0 2023-02-16 14:01:07,352 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44339,1676556062214' ***** 2023-02-16 14:01:07,352 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:07,353 DEBUG [M:0;jenkins-hbase20:44339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66e2fbf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:07,353 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44339,1676556062214 2023-02-16 14:01:07,353 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44339,1676556062214; all regions closed. 2023-02-16 14:01:07,353 DEBUG [M:0;jenkins-hbase20:44339] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:07,353 DEBUG [M:0;jenkins-hbase20:44339] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:07,353 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:07,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556062497] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556062497,5,FailOnTimeoutGroup] 2023-02-16 14:01:07,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556062497] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556062497,5,FailOnTimeoutGroup] 2023-02-16 14:01:07,353 DEBUG [M:0;jenkins-hbase20:44339] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:07,354 INFO [M:0;jenkins-hbase20:44339] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:07,354 INFO [M:0;jenkins-hbase20:44339] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:07,355 INFO [M:0;jenkins-hbase20:44339] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:07,355 DEBUG [M:0;jenkins-hbase20:44339] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:07,355 INFO [M:0;jenkins-hbase20:44339] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:07,355 ERROR [M:0;jenkins-hbase20:44339] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:07,355 INFO [M:0;jenkins-hbase20:44339] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:07,355 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:07,360 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:07,360 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:07,361 DEBUG [M:0;jenkins-hbase20:44339] zookeeper.ZKUtil(398): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:07,361 WARN [M:0;jenkins-hbase20:44339] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:07,361 INFO [M:0;jenkins-hbase20:44339] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:07,361 INFO [M:0;jenkins-hbase20:44339] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:07,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:07,361 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:07,361 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:07,361 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:07,362 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:07,362 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:07,362 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=101.12 KB heapSize=120.84 KB 2023-02-16 14:01:07,378 INFO [M:0;jenkins-hbase20:44339] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=101.12 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/22474027ab4b400787ac3bc79c44c2bb 2023-02-16 14:01:07,385 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/22474027ab4b400787ac3bc79c44c2bb as hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/22474027ab4b400787ac3bc79c44c2bb 2023-02-16 14:01:07,392 INFO [M:0;jenkins-hbase20:44339] regionserver.HStore(1080): Added hdfs://localhost.localdomain:32983/user/jenkins/test-data/7d687fb6-352e-9987-e8a6-6a8173733d12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/22474027ab4b400787ac3bc79c44c2bb, entries=31, sequenceid=218, filesize=9.0 K 2023-02-16 14:01:07,394 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegion(2947): Finished flush of dataSize ~101.12 KB/103547, heapSize ~120.82 KB/123720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=218, compaction requested=false 2023-02-16 14:01:07,395 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:07,395 DEBUG [M:0;jenkins-hbase20:44339] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:07,402 INFO [M:0;jenkins-hbase20:44339] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:07,402 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:07,402 INFO [M:0;jenkins-hbase20:44339] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44339 2023-02-16 14:01:07,407 DEBUG [M:0;jenkins-hbase20:44339] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44339,1676556062214 already deleted, retry=false 2023-02-16 14:01:07,593 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,593 INFO [M:0;jenkins-hbase20:44339] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44339,1676556062214; zookeeper connection closed. 2023-02-16 14:01:07,593 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3587654a rejected from java.util.concurrent.ThreadPoolExecutor@31b8e722[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,594 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): master:44339-0x1016b970f9c0000, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,594 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b275fa8 rejected from java.util.concurrent.ThreadPoolExecutor@31b8e722[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,693 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,693 INFO [RS:0;jenkins-hbase20:45629] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,45629,1676556062276; zookeeper connection closed. 2023-02-16 14:01:07,694 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4092291f rejected from java.util.concurrent.ThreadPoolExecutor@706988d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,694 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@363c2e3f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@363c2e3f 2023-02-16 14:01:07,694 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:45629-0x1016b970f9c0001, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,694 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@380746c7 rejected from java.util.concurrent.ThreadPoolExecutor@706988d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,794 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,794 INFO [RS:1;jenkins-hbase20:42653] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42653,1676556062311; zookeeper connection closed. 2023-02-16 14:01:07,794 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f886027 rejected from java.util.concurrent.ThreadPoolExecutor@53b66003[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,794 DEBUG [Listener at localhost.localdomain/35977-EventThread] zookeeper.ZKWatcher(600): regionserver:42653-0x1016b970f9c0002, quorum=127.0.0.1:55872, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:07,794 ERROR [Listener at localhost.localdomain/35977-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47be6bc4 rejected from java.util.concurrent.ThreadPoolExecutor@53b66003[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:07,795 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17ea752] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17ea752 2023-02-16 14:01:07,795 INFO [Listener at localhost.localdomain/35977] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:07,901 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop-2180631712832987491.jar 2023-02-16 14:01:07,905 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676556064706 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:07,905 DEBUG [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce 2023-02-16 14:01:07,906 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:07,906 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:07,906 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:07,906 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(239): region to add: f6896c72887e9953363d11833443458e 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=e972c2f201c4cc45e0bbe50dc31666ec as e972c2f201c4cc45e0bbe50dc31666ec in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=6b89a06ea80b91c28009516fbf9881c5 as 6b89a06ea80b91c28009516fbf9881c5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=b5eece579c05abd7b46ca8eef60dcb5e as b5eece579c05abd7b46ca8eef60dcb5e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,907 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=93215024d230adf395c90171b41a1e8d as 93215024d230adf395c90171b41a1e8d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=9c3500c833234e63fb20f7bc4d6252f3 as 9c3500c833234e63fb20f7bc4d6252f3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=8f501efca2d0ca55f6f916f2d47a8fea as 8f501efca2d0ca55f6f916f2d47a8fea in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=42bf7bcdd8d45fbbec523f50ebc1b333 as 42bf7bcdd8d45fbbec523f50ebc1b333 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=5972a40aaf60a8fdee56ec1a9d05f7f9 as 5972a40aaf60a8fdee56ec1a9d05f7f9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=4ac527702920deb5385f032a43f483e6 as 4ac527702920deb5385f032a43f483e6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,908 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(585): clone region=f6896c72887e9953363d11833443458e as f6896c72887e9953363d11833443458e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 14:01:07,910 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => b5eece579c05abd7b46ca8eef60dcb5e, NAME => 'testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5972a40aaf60a8fdee56ec1a9d05f7f9, NAME => 'testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 42bf7bcdd8d45fbbec523f50ebc1b333, NAME => 'testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8f501efca2d0ca55f6f916f2d47a8fea, NAME => 'testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6b89a06ea80b91c28009516fbf9881c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 93215024d230adf395c90171b41a1e8d, NAME => 'testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,911 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e972c2f201c4cc45e0bbe50dc31666ec, NAME => 'testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,912 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 9c3500c833234e63fb20f7bc4d6252f3, NAME => 'testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,931 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,932 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing b5eece579c05abd7b46ca8eef60dcb5e, disabling compactions & flushes 2023-02-16 14:01:07,932 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,932 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,932 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. after waiting 0 ms 2023-02-16 14:01:07,932 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,932 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:07,932 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:07,932 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4ac527702920deb5385f032a43f483e6, NAME => 'testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,933 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,933 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 429faab0ca9f4b72a6f217bd007dae4a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 9c3500c833234e63fb20f7bc4d6252f3, disabling compactions & flushes 2023-02-16 14:01:07,939 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. after waiting 0 ms 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,939 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:07,939 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:07,939 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb9fa4e3ab1e484390f34a6c7718954d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,939 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => f6896c72887e9953363d11833443458e, NAME => 'testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:07,943 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,943 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9465b55702d4d7788a6cf274595a71f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,950 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,950 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 586b3e113bb04dfa9e18dd6fe5bb4667 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,950 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,950 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c8f52cb052b4f8db7f917e779f1b59c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,953 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 93215024d230adf395c90171b41a1e8d, disabling compactions & flushes 2023-02-16 14:01:07,954 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,954 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,954 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. after waiting 0 ms 2023-02-16 14:01:07,954 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,954 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c3ae0e7fe24445e989b0791d0332b9f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,954 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:07,954 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1ce689284ce419b930291a1226f4689 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,954 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:07,955 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 782efaea64dc4d909ca084122dca8c05 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,955 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,955 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d0ba6e54fb524a9fb41febbe775dddb8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:07,957 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1863e729a29a43579960fe125b0c06dc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8f501efca2d0ca55f6f916f2d47a8fea, disabling compactions & flushes 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 6b89a06ea80b91c28009516fbf9881c5, disabling compactions & flushes 2023-02-16 14:01:07,957 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,957 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. after waiting 0 ms 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. after waiting 0 ms 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 42bf7bcdd8d45fbbec523f50ebc1b333, disabling compactions & flushes 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,957 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,957 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,957 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:07,958 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. after waiting 0 ms 2023-02-16 14:01:07,958 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:07,958 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,958 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:07,958 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:07,958 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:07,958 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:07,958 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ca1db71b439e4aee8ef4c2656c53f823 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,958 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f0bec027e704260a2abb2ab913ed297 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:07,959 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4ac527702920deb5385f032a43f483e6, disabling compactions & flushes 2023-02-16 14:01:07,960 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. after waiting 0 ms 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,960 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e972c2f201c4cc45e0bbe50dc31666ec, disabling compactions & flushes 2023-02-16 14:01:07,960 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. after waiting 0 ms 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,960 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:07,960 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:08,353 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,353 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,353 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 046223787af242fea033728cab521256 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:08,353 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1d06359a6ff142639e94fe72523ad901 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:08,358 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60a24b2666284033822d9c243243144e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:08,358 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b0525b1f52944d0b9edd65780e412e83 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5972a40aaf60a8fdee56ec1a9d05f7f9, disabling compactions & flushes 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing f6896c72887e9953363d11833443458e, disabling compactions & flushes 2023-02-16 14:01:08,362 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,362 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. after waiting 0 ms 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. after waiting 0 ms 2023-02-16 14:01:08,362 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:08,363 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:08,363 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:08,363 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,363 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,363 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:08,363 INFO [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676556064706 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:08,363 DEBUG [Listener at localhost.localdomain/35977] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:08,363 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159 2023-02-16 14:01:08,364 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:08,364 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:08,364 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 14:01:08,365 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------42bf7bcdd8d45fbbec523f50ebc1b333/ 2023-02-16 14:01:08,365 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,365 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,366 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=42bf7bcdd8d45fbbec523f50ebc1b333-8c8f52cb052b4f8db7f917e779f1b59c 2023-02-16 14:01:08,366 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,366 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=42bf7bcdd8d45fbbec523f50ebc1b333-782efaea64dc4d909ca084122dca8c05 2023-02-16 14:01:08,366 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------4ac527702920deb5385f032a43f483e6/ 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=4ac527702920deb5385f032a43f483e6-d0ba6e54fb524a9fb41febbe775dddb8 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=4ac527702920deb5385f032a43f483e6-ca1db71b439e4aee8ef4c2656c53f823 2023-02-16 14:01:08,367 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------5972a40aaf60a8fdee56ec1a9d05f7f9/ 2023-02-16 14:01:08,368 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,368 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,368 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=5972a40aaf60a8fdee56ec1a9d05f7f9-046223787af242fea033728cab521256 2023-02-16 14:01:08,368 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=5972a40aaf60a8fdee56ec1a9d05f7f9-60a24b2666284033822d9c243243144e 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------6b89a06ea80b91c28009516fbf9881c5/ 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=6b89a06ea80b91c28009516fbf9881c5-a9465b55702d4d7788a6cf274595a71f 2023-02-16 14:01:08,369 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,370 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=6b89a06ea80b91c28009516fbf9881c5-b1ce689284ce419b930291a1226f4689 2023-02-16 14:01:08,370 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------8f501efca2d0ca55f6f916f2d47a8fea/ 2023-02-16 14:01:08,370 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,370 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,371 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=8f501efca2d0ca55f6f916f2d47a8fea-586b3e113bb04dfa9e18dd6fe5bb4667 2023-02-16 14:01:08,371 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,371 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=8f501efca2d0ca55f6f916f2d47a8fea-9c3ae0e7fe24445e989b0791d0332b9f 2023-02-16 14:01:08,371 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------93215024d230adf395c90171b41a1e8d/ 2023-02-16 14:01:08,372 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,372 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,372 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=93215024d230adf395c90171b41a1e8d-429faab0ca9f4b72a6f217bd007dae4a 2023-02-16 14:01:08,372 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,373 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=93215024d230adf395c90171b41a1e8d-fb9fa4e3ab1e484390f34a6c7718954d 2023-02-16 14:01:08,373 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------9c3500c833234e63fb20f7bc4d6252f3/ 2023-02-16 14:01:08,373 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,373 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------b5eece579c05abd7b46ca8eef60dcb5e/ 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------e972c2f201c4cc45e0bbe50dc31666ec/ 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=e972c2f201c4cc45e0bbe50dc31666ec-1863e729a29a43579960fe125b0c06dc 2023-02-16 14:01:08,374 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,375 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=e972c2f201c4cc45e0bbe50dc31666ec-7f0bec027e704260a2abb2ab913ed297 2023-02-16 14:01:08,375 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |----------f6896c72887e9953363d11833443458e/ 2023-02-16 14:01:08,375 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:08,375 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:08,376 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=f6896c72887e9953363d11833443458e-1d06359a6ff142639e94fe72523ad901 2023-02-16 14:01:08,376 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:08,376 DEBUG [Listener at localhost.localdomain/35977] util.CommonFSUtils(702): |----------------testWithMapReduce=f6896c72887e9953363d11833443458e-b0525b1f52944d0b9edd65780e412e83 2023-02-16 14:01:08,377 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,377 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,377 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,378 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,378 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,378 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,379 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,435 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop-2611879451515916504.jar 2023-02-16 14:01:08,436 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,436 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,437 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,437 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,437 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,438 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,438 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 14:01:08,438 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 14:01:08,439 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 14:01:08,439 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 14:01:08,439 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 14:01:08,440 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 14:01:08,440 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 14:01:08,440 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 14:01:08,441 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 14:01:08,441 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 14:01:08,441 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:08,442 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:08,442 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:08,442 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:08,442 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:01:08,497 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop-2157857882785688431.jar 2023-02-16 14:01:08,497 DEBUG [Listener at localhost.localdomain/35977] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:01:08,501 WARN [Listener at localhost.localdomain/35977] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 14:01:08,526 INFO [Listener at localhost.localdomain/35977] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 14:01:08,648 WARN [Listener at localhost.localdomain/35977] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/mapreduce.cluster.local.dir/1676556068611/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 14:01:08,648 WARN [Listener at localhost.localdomain/35977] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/mapreduce.cluster.local.dir/1676556068611/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 14:01:08,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,687 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,688 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,690 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:08,691 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1 2023-02-16 14:01:08,691 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42bf7bcdd8d45fbbec523f50ebc1b333 columnFamilyName f1 2023-02-16 14:01:08,699 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f1/testWithMapReduce=42bf7bcdd8d45fbbec523f50ebc1b333-8c8f52cb052b4f8db7f917e779f1b59c 2023-02-16 14:01:08,699 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(310): Store=42bf7bcdd8d45fbbec523f50ebc1b333/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,699 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 42bf7bcdd8d45fbbec523f50ebc1b333 2023-02-16 14:01:08,700 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2 2023-02-16 14:01:08,700 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42bf7bcdd8d45fbbec523f50ebc1b333 columnFamilyName f2 2023-02-16 14:01:08,705 DEBUG [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/42bf7bcdd8d45fbbec523f50ebc1b333/f2/testWithMapReduce=42bf7bcdd8d45fbbec523f50ebc1b333-782efaea64dc4d909ca084122dca8c05 2023-02-16 14:01:08,705 INFO [StoreOpener-42bf7bcdd8d45fbbec523f50ebc1b333-1] regionserver.HStore(310): Store=42bf7bcdd8d45fbbec523f50ebc1b333/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,705 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 42bf7bcdd8d45fbbec523f50ebc1b333; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65472820, jitterRate=-0.024378955364227295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:08,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 42bf7bcdd8d45fbbec523f50ebc1b333, disabling compactions & flushes 2023-02-16 14:01:08,731 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:08,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:08,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. after waiting 0 ms 2023-02-16 14:01:08,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:08,735 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676556063854.42bf7bcdd8d45fbbec523f50ebc1b333. 2023-02-16 14:01:08,735 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 42bf7bcdd8d45fbbec523f50ebc1b333: 2023-02-16 14:01:08,737 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,738 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,738 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,740 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:08,741 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1 2023-02-16 14:01:08,741 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b89a06ea80b91c28009516fbf9881c5 columnFamilyName f1 2023-02-16 14:01:08,746 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f1/testWithMapReduce=6b89a06ea80b91c28009516fbf9881c5-a9465b55702d4d7788a6cf274595a71f 2023-02-16 14:01:08,746 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(310): Store=6b89a06ea80b91c28009516fbf9881c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,746 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b89a06ea80b91c28009516fbf9881c5 2023-02-16 14:01:08,747 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2 2023-02-16 14:01:08,747 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b89a06ea80b91c28009516fbf9881c5 columnFamilyName f2 2023-02-16 14:01:08,752 DEBUG [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/6b89a06ea80b91c28009516fbf9881c5/f2/testWithMapReduce=6b89a06ea80b91c28009516fbf9881c5-b1ce689284ce419b930291a1226f4689 2023-02-16 14:01:08,752 INFO [StoreOpener-6b89a06ea80b91c28009516fbf9881c5-1] regionserver.HStore(310): Store=6b89a06ea80b91c28009516fbf9881c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,753 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6b89a06ea80b91c28009516fbf9881c5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70586395, jitterRate=0.051819249987602234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:08,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6b89a06ea80b91c28009516fbf9881c5, disabling compactions & flushes 2023-02-16 14:01:08,774 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:08,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:08,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. after waiting 0 ms 2023-02-16 14:01:08,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:08,775 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676556063854.6b89a06ea80b91c28009516fbf9881c5. 2023-02-16 14:01:08,775 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6b89a06ea80b91c28009516fbf9881c5: 2023-02-16 14:01:08,778 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,779 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,780 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,781 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:08,783 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f1 2023-02-16 14:01:08,783 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3500c833234e63fb20f7bc4d6252f3 columnFamilyName f1 2023-02-16 14:01:08,784 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(310): Store=9c3500c833234e63fb20f7bc4d6252f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,784 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c3500c833234e63fb20f7bc4d6252f3 2023-02-16 14:01:08,785 DEBUG [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/9c3500c833234e63fb20f7bc4d6252f3/f2 2023-02-16 14:01:08,785 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3500c833234e63fb20f7bc4d6252f3 columnFamilyName f2 2023-02-16 14:01:08,786 INFO [StoreOpener-9c3500c833234e63fb20f7bc4d6252f3-1] regionserver.HStore(310): Store=9c3500c833234e63fb20f7bc4d6252f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,786 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,786 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9c3500c833234e63fb20f7bc4d6252f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64372152, jitterRate=-0.04078018665313721}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,786 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:08,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9c3500c833234e63fb20f7bc4d6252f3, disabling compactions & flushes 2023-02-16 14:01:08,795 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:08,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:08,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. after waiting 0 ms 2023-02-16 14:01:08,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:08,795 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676556063854.9c3500c833234e63fb20f7bc4d6252f3. 2023-02-16 14:01:08,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9c3500c833234e63fb20f7bc4d6252f3: 2023-02-16 14:01:08,799 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,799 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,800 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,802 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:08,803 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1 2023-02-16 14:01:08,803 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5972a40aaf60a8fdee56ec1a9d05f7f9 columnFamilyName f1 2023-02-16 14:01:08,808 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f1/testWithMapReduce=5972a40aaf60a8fdee56ec1a9d05f7f9-046223787af242fea033728cab521256 2023-02-16 14:01:08,808 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(310): Store=5972a40aaf60a8fdee56ec1a9d05f7f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,808 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5972a40aaf60a8fdee56ec1a9d05f7f9 2023-02-16 14:01:08,809 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2 2023-02-16 14:01:08,810 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5972a40aaf60a8fdee56ec1a9d05f7f9 columnFamilyName f2 2023-02-16 14:01:08,814 DEBUG [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/5972a40aaf60a8fdee56ec1a9d05f7f9/f2/testWithMapReduce=5972a40aaf60a8fdee56ec1a9d05f7f9-60a24b2666284033822d9c243243144e 2023-02-16 14:01:08,815 INFO [StoreOpener-5972a40aaf60a8fdee56ec1a9d05f7f9-1] regionserver.HStore(310): Store=5972a40aaf60a8fdee56ec1a9d05f7f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,815 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5972a40aaf60a8fdee56ec1a9d05f7f9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68930320, jitterRate=0.027141809463500977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:08,858 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5972a40aaf60a8fdee56ec1a9d05f7f9, disabling compactions & flushes 2023-02-16 14:01:08,858 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,858 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,858 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. after waiting 0 ms 2023-02-16 14:01:08,858 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,859 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676556063854.5972a40aaf60a8fdee56ec1a9d05f7f9. 2023-02-16 14:01:08,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5972a40aaf60a8fdee56ec1a9d05f7f9: 2023-02-16 14:01:08,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,863 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,865 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,867 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:08,868 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1 2023-02-16 14:01:08,869 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ac527702920deb5385f032a43f483e6 columnFamilyName f1 2023-02-16 14:01:08,875 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f1/testWithMapReduce=4ac527702920deb5385f032a43f483e6-d0ba6e54fb524a9fb41febbe775dddb8 2023-02-16 14:01:08,875 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(310): Store=4ac527702920deb5385f032a43f483e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,875 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ac527702920deb5385f032a43f483e6 2023-02-16 14:01:08,877 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2 2023-02-16 14:01:08,877 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ac527702920deb5385f032a43f483e6 columnFamilyName f2 2023-02-16 14:01:08,883 DEBUG [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/4ac527702920deb5385f032a43f483e6/f2/testWithMapReduce=4ac527702920deb5385f032a43f483e6-ca1db71b439e4aee8ef4c2656c53f823 2023-02-16 14:01:08,883 INFO [StoreOpener-4ac527702920deb5385f032a43f483e6-1] regionserver.HStore(310): Store=4ac527702920deb5385f032a43f483e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,883 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,883 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4ac527702920deb5385f032a43f483e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69651270, jitterRate=0.037884801626205444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:08,903 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4ac527702920deb5385f032a43f483e6, disabling compactions & flushes 2023-02-16 14:01:08,903 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:08,903 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:08,903 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. after waiting 0 ms 2023-02-16 14:01:08,903 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:08,905 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676556063854.4ac527702920deb5385f032a43f483e6. 2023-02-16 14:01:08,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4ac527702920deb5385f032a43f483e6: 2023-02-16 14:01:08,908 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,908 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,910 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,916 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:08,918 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1 2023-02-16 14:01:08,918 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e972c2f201c4cc45e0bbe50dc31666ec columnFamilyName f1 2023-02-16 14:01:08,924 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f1/testWithMapReduce=e972c2f201c4cc45e0bbe50dc31666ec-1863e729a29a43579960fe125b0c06dc 2023-02-16 14:01:08,925 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(310): Store=e972c2f201c4cc45e0bbe50dc31666ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,925 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e972c2f201c4cc45e0bbe50dc31666ec 2023-02-16 14:01:08,926 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2 2023-02-16 14:01:08,927 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e972c2f201c4cc45e0bbe50dc31666ec columnFamilyName f2 2023-02-16 14:01:08,934 DEBUG [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/e972c2f201c4cc45e0bbe50dc31666ec/f2/testWithMapReduce=e972c2f201c4cc45e0bbe50dc31666ec-7f0bec027e704260a2abb2ab913ed297 2023-02-16 14:01:08,934 INFO [StoreOpener-e972c2f201c4cc45e0bbe50dc31666ec-1] regionserver.HStore(310): Store=e972c2f201c4cc45e0bbe50dc31666ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,934 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e972c2f201c4cc45e0bbe50dc31666ec; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70771283, jitterRate=0.05457429587841034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:08,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e972c2f201c4cc45e0bbe50dc31666ec, disabling compactions & flushes 2023-02-16 14:01:08,961 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:08,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:08,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. after waiting 1 ms 2023-02-16 14:01:08,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:08,963 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676556063854.e972c2f201c4cc45e0bbe50dc31666ec. 2023-02-16 14:01:08,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e972c2f201c4cc45e0bbe50dc31666ec: 2023-02-16 14:01:08,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,966 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,967 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,970 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:08,972 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f1 2023-02-16 14:01:08,972 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5eece579c05abd7b46ca8eef60dcb5e columnFamilyName f1 2023-02-16 14:01:08,973 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(310): Store=b5eece579c05abd7b46ca8eef60dcb5e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,973 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b5eece579c05abd7b46ca8eef60dcb5e 2023-02-16 14:01:08,975 DEBUG [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/b5eece579c05abd7b46ca8eef60dcb5e/f2 2023-02-16 14:01:08,975 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5eece579c05abd7b46ca8eef60dcb5e columnFamilyName f2 2023-02-16 14:01:08,976 INFO [StoreOpener-b5eece579c05abd7b46ca8eef60dcb5e-1] regionserver.HStore(310): Store=b5eece579c05abd7b46ca8eef60dcb5e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:08,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:08,976 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b5eece579c05abd7b46ca8eef60dcb5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62293220, jitterRate=-0.0717586874961853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:08,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b5eece579c05abd7b46ca8eef60dcb5e, disabling compactions & flushes 2023-02-16 14:01:08,985 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. after waiting 0 ms 2023-02-16 14:01:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:08,985 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556063854.b5eece579c05abd7b46ca8eef60dcb5e. 2023-02-16 14:01:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b5eece579c05abd7b46ca8eef60dcb5e: 2023-02-16 14:01:08,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:08,988 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:08,989 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:08,991 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:08,993 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1 2023-02-16 14:01:08,993 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93215024d230adf395c90171b41a1e8d columnFamilyName f1 2023-02-16 14:01:09,000 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f1/testWithMapReduce=93215024d230adf395c90171b41a1e8d-429faab0ca9f4b72a6f217bd007dae4a 2023-02-16 14:01:09,000 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(310): Store=93215024d230adf395c90171b41a1e8d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,000 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93215024d230adf395c90171b41a1e8d 2023-02-16 14:01:09,001 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2 2023-02-16 14:01:09,002 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93215024d230adf395c90171b41a1e8d columnFamilyName f2 2023-02-16 14:01:09,007 DEBUG [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/93215024d230adf395c90171b41a1e8d/f2/testWithMapReduce=93215024d230adf395c90171b41a1e8d-fb9fa4e3ab1e484390f34a6c7718954d 2023-02-16 14:01:09,007 INFO [StoreOpener-93215024d230adf395c90171b41a1e8d-1] regionserver.HStore(310): Store=93215024d230adf395c90171b41a1e8d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:09,008 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 93215024d230adf395c90171b41a1e8d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59585626, jitterRate=-0.11210498213768005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:09,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:09,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 93215024d230adf395c90171b41a1e8d, disabling compactions & flushes 2023-02-16 14:01:09,033 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:09,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:09,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. after waiting 0 ms 2023-02-16 14:01:09,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:09,034 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676556063854.93215024d230adf395c90171b41a1e8d. 2023-02-16 14:01:09,034 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 93215024d230adf395c90171b41a1e8d: 2023-02-16 14:01:09,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:09,038 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:09,042 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:09,044 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6896c72887e9953363d11833443458e 2023-02-16 14:01:09,045 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1 2023-02-16 14:01:09,045 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6896c72887e9953363d11833443458e columnFamilyName f1 2023-02-16 14:01:09,051 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f1/testWithMapReduce=f6896c72887e9953363d11833443458e-1d06359a6ff142639e94fe72523ad901 2023-02-16 14:01:09,051 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(310): Store=f6896c72887e9953363d11833443458e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,051 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6896c72887e9953363d11833443458e 2023-02-16 14:01:09,052 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2 2023-02-16 14:01:09,052 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6896c72887e9953363d11833443458e columnFamilyName f2 2023-02-16 14:01:09,057 DEBUG [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/f6896c72887e9953363d11833443458e/f2/testWithMapReduce=f6896c72887e9953363d11833443458e-b0525b1f52944d0b9edd65780e412e83 2023-02-16 14:01:09,057 INFO [StoreOpener-f6896c72887e9953363d11833443458e-1] regionserver.HStore(310): Store=f6896c72887e9953363d11833443458e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:09,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f6896c72887e9953363d11833443458e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62426902, jitterRate=-0.06976667046546936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:09,058 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:09,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f6896c72887e9953363d11833443458e, disabling compactions & flushes 2023-02-16 14:01:09,089 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:09,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:09,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. after waiting 0 ms 2023-02-16 14:01:09,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:09,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676556063854.f6896c72887e9953363d11833443458e. 2023-02-16 14:01:09,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f6896c72887e9953363d11833443458e: 2023-02-16 14:01:09,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:09,093 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:09,094 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:09,096 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:09,098 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1 2023-02-16 14:01:09,098 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f501efca2d0ca55f6f916f2d47a8fea columnFamilyName f1 2023-02-16 14:01:09,104 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f1/testWithMapReduce=8f501efca2d0ca55f6f916f2d47a8fea-586b3e113bb04dfa9e18dd6fe5bb4667 2023-02-16 14:01:09,104 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(310): Store=8f501efca2d0ca55f6f916f2d47a8fea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,104 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8f501efca2d0ca55f6f916f2d47a8fea 2023-02-16 14:01:09,105 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2 2023-02-16 14:01:09,105 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f501efca2d0ca55f6f916f2d47a8fea columnFamilyName f2 2023-02-16 14:01:09,111 DEBUG [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:32983/user/jenkins/test-data/afdd5f56-fce4-33aa-156a-9db41b06fe62/testWithMapReduceAndOfflineHBaseMultiRegion/d9fb2555-400c-4003-937b-5d0ccd4cc159/data/default/testWithMapReduce/8f501efca2d0ca55f6f916f2d47a8fea/f2/testWithMapReduce=8f501efca2d0ca55f6f916f2d47a8fea-9c3ae0e7fe24445e989b0791d0332b9f 2023-02-16 14:01:09,111 INFO [StoreOpener-8f501efca2d0ca55f6f916f2d47a8fea-1] regionserver.HStore(310): Store=8f501efca2d0ca55f6f916f2d47a8fea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:09,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:09,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8f501efca2d0ca55f6f916f2d47a8fea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69075842, jitterRate=0.029310256242752075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:09,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:09,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8f501efca2d0ca55f6f916f2d47a8fea, disabling compactions & flushes 2023-02-16 14:01:09,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:09,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:09,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. after waiting 0 ms 2023-02-16 14:01:09,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:09,137 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676556063854.8f501efca2d0ca55f6f916f2d47a8fea. 2023-02-16 14:01:09,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8f501efca2d0ca55f6f916f2d47a8fea: 2023-02-16 14:01:09,692 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:09,692 WARN [Listener at localhost.localdomain/35977] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:09,697 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:09,807 WARN [BP-1075074797-148.251.75.209-1676556061645 heartbeating to localhost.localdomain/127.0.0.1:32983] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:09,807 WARN [BP-1075074797-148.251.75.209-1676556061645 heartbeating to localhost.localdomain/127.0.0.1:32983] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1075074797-148.251.75.209-1676556061645 (Datanode Uuid 99434264-2e26-4036-98e0-78209670cdc2) service to localhost.localdomain/127.0.0.1:32983 2023-02-16 14:01:09,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/dfs/data/data3/current/BP-1075074797-148.251.75.209-1676556061645] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:09,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/dfs/data/data4/current/BP-1075074797-148.251.75.209-1676556061645] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:09,811 WARN [Listener at localhost.localdomain/35977] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:09,816 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:09,921 WARN [BP-1075074797-148.251.75.209-1676556061645 heartbeating to localhost.localdomain/127.0.0.1:32983] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:09,921 WARN [BP-1075074797-148.251.75.209-1676556061645 heartbeating to localhost.localdomain/127.0.0.1:32983] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1075074797-148.251.75.209-1676556061645 (Datanode Uuid 73e14bb9-96a6-4e91-b180-b184f17c3ae7) service to localhost.localdomain/127.0.0.1:32983 2023-02-16 14:01:09,922 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/dfs/data/data1/current/BP-1075074797-148.251.75.209-1676556061645] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:09,923 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/cluster_842d37bb-d3c5-af91-319a-3e8b1c7bd314/dfs/data/data2/current/BP-1075074797-148.251.75.209-1676556061645] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:09,934 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:10,059 INFO [Listener at localhost.localdomain/35977] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:10,102 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:10,114 INFO [Listener at localhost.localdomain/35977] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=159 (was 103) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:32983 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/35977 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:32983 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:32983 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:32983 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost.localdomain:32983 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:32983 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:32983 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase20.apache.org,44339,1676556062214)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=539 (was 543), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3205 (was 3736) 2023-02-16 14:01:10,124 INFO [Listener at localhost.localdomain/35977] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=159, OpenFileDescriptor=539, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=166, AvailableMemoryMB=3205 2023-02-16 14:01:10,136 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.log.dir so I do NOT create it in target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c 2023-02-16 14:01:10,136 WARN [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:10,136 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.tmp.dir so I do NOT create it in target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c 2023-02-16 14:01:10,136 WARN [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49ebbd3d-b5d5-d78f-aab9-a0aa255026e5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:10,136 DEBUG [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c, deleteOnExit=true 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/test.cache.data in system properties and HBase conf 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:10,137 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:10,138 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:10,138 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:10,138 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:10,138 DEBUG [Listener at localhost.localdomain/35977] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:10,138 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:10,139 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:10,140 INFO [Listener at localhost.localdomain/35977] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:10,142 WARN [Listener at localhost.localdomain/35977] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:10,142 WARN [Listener at localhost.localdomain/35977] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:10,168 WARN [Listener at localhost.localdomain/35977] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:10,170 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:10,175 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/java.io.tmpdir/Jetty_localhost_localdomain_33897_hdfs____7cw9u8/webapp 2023-02-16 14:01:10,258 INFO [Listener at localhost.localdomain/35977] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:33897 2023-02-16 14:01:10,260 WARN [Listener at localhost.localdomain/35977] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:10,261 WARN [Listener at localhost.localdomain/35977] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:10,310 WARN [Listener at localhost.localdomain/43431] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:10,339 WARN [Listener at localhost.localdomain/43431] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:10,342 WARN [Listener at localhost.localdomain/43431] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:10,344 INFO [Listener at localhost.localdomain/43431] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:10,350 INFO [Listener at localhost.localdomain/43431] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/java.io.tmpdir/Jetty_localhost_44229_datanode____.v5ujhc/webapp 2023-02-16 14:01:10,459 INFO [Listener at localhost.localdomain/43431] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44229 2023-02-16 14:01:10,471 WARN [Listener at localhost.localdomain/34463] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:10,518 WARN [Listener at localhost.localdomain/34463] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:10,520 WARN [Listener at localhost.localdomain/34463] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:10,522 INFO [Listener at localhost.localdomain/34463] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:10,531 INFO [Listener at localhost.localdomain/34463] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/java.io.tmpdir/Jetty_localhost_35745_datanode____.5o42pv/webapp 2023-02-16 14:01:10,576 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaee5a9e08fca5b5e: Processing first storage report for DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34 from datanode a38882c1-0e00-470f-88dc-c9c4ca65e9cb 2023-02-16 14:01:10,576 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaee5a9e08fca5b5e: from storage DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34 node DatanodeRegistration(127.0.0.1:33655, datanodeUuid=a38882c1-0e00-470f-88dc-c9c4ca65e9cb, infoPort=42645, infoSecurePort=0, ipcPort=34463, storageInfo=lv=-57;cid=testClusterID;nsid=1267911743;c=1676556070144), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:10,576 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaee5a9e08fca5b5e: Processing first storage report for DS-721f7bf2-a9b3-474b-a7a7-6bd3e9096378 from datanode a38882c1-0e00-470f-88dc-c9c4ca65e9cb 2023-02-16 14:01:10,577 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaee5a9e08fca5b5e: from storage DS-721f7bf2-a9b3-474b-a7a7-6bd3e9096378 node DatanodeRegistration(127.0.0.1:33655, datanodeUuid=a38882c1-0e00-470f-88dc-c9c4ca65e9cb, infoPort=42645, infoSecurePort=0, ipcPort=34463, storageInfo=lv=-57;cid=testClusterID;nsid=1267911743;c=1676556070144), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:10,621 INFO [Listener at localhost.localdomain/34463] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35745 2023-02-16 14:01:10,629 WARN [Listener at localhost.localdomain/35365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:10,708 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11a337a7969d5c91: Processing first storage report for DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2 from datanode b716f55b-320a-4cfd-8459-9392de7654c8 2023-02-16 14:01:10,708 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11a337a7969d5c91: from storage DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2 node DatanodeRegistration(127.0.0.1:36427, datanodeUuid=b716f55b-320a-4cfd-8459-9392de7654c8, infoPort=45181, infoSecurePort=0, ipcPort=35365, storageInfo=lv=-57;cid=testClusterID;nsid=1267911743;c=1676556070144), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 14:01:10,708 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11a337a7969d5c91: Processing first storage report for DS-51075115-d4df-4bf7-a9c6-950e87e26902 from datanode b716f55b-320a-4cfd-8459-9392de7654c8 2023-02-16 14:01:10,708 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11a337a7969d5c91: from storage DS-51075115-d4df-4bf7-a9c6-950e87e26902 node DatanodeRegistration(127.0.0.1:36427, datanodeUuid=b716f55b-320a-4cfd-8459-9392de7654c8, infoPort=45181, infoSecurePort=0, ipcPort=35365, storageInfo=lv=-57;cid=testClusterID;nsid=1267911743;c=1676556070144), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:10,743 DEBUG [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c 2023-02-16 14:01:10,746 INFO [Listener at localhost.localdomain/35365] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/zookeeper_0, clientPort=50466, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:10,752 INFO [Listener at localhost.localdomain/35365] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50466 2023-02-16 14:01:10,752 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,754 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,769 INFO [Listener at localhost.localdomain/35365] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf with version=8 2023-02-16 14:01:10,769 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,770 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,772 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:43431/user/jenkins/test-data/08cb89a5-24a6-c1e3-5508-b4cab4b310b7/hbase-staging 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:10,774 INFO [Listener at localhost.localdomain/35365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:10,776 INFO [Listener at localhost.localdomain/35365] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39623 2023-02-16 14:01:10,776 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,778 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,779 INFO [Listener at localhost.localdomain/35365] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39623 connecting to ZooKeeper ensemble=127.0.0.1:50466 2023-02-16 14:01:10,786 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:396230x0, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:10,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39623-0x1016b9731080000 connected 2023-02-16 14:01:10,809 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:10,809 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:10,810 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:10,810 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39623 2023-02-16 14:01:10,811 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39623 2023-02-16 14:01:10,811 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39623 2023-02-16 14:01:10,811 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39623 2023-02-16 14:01:10,811 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39623 2023-02-16 14:01:10,811 INFO [Listener at localhost.localdomain/35365] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf, hbase.cluster.distributed=false 2023-02-16 14:01:10,823 INFO [Listener at localhost.localdomain/35365] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:10,823 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,824 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,824 INFO [Listener at localhost.localdomain/35365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:10,824 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,824 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:10,824 INFO [Listener at localhost.localdomain/35365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:10,827 INFO [Listener at localhost.localdomain/35365] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37247 2023-02-16 14:01:10,827 INFO [Listener at localhost.localdomain/35365] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:10,829 DEBUG [Listener at localhost.localdomain/35365] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:10,829 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,830 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,831 INFO [Listener at localhost.localdomain/35365] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37247 connecting to ZooKeeper ensemble=127.0.0.1:50466 2023-02-16 14:01:10,836 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:372470x0, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:10,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37247-0x1016b9731080001 connected 2023-02-16 14:01:10,838 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:10,839 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:10,840 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:10,841 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37247 2023-02-16 14:01:10,842 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37247 2023-02-16 14:01:10,843 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37247 2023-02-16 14:01:10,843 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37247 2023-02-16 14:01:10,844 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37247 2023-02-16 14:01:10,856 INFO [Listener at localhost.localdomain/35365] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:10,856 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,856 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,857 INFO [Listener at localhost.localdomain/35365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:10,857 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:10,857 INFO [Listener at localhost.localdomain/35365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:10,857 INFO [Listener at localhost.localdomain/35365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:10,861 INFO [Listener at localhost.localdomain/35365] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42649 2023-02-16 14:01:10,861 INFO [Listener at localhost.localdomain/35365] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:10,867 DEBUG [Listener at localhost.localdomain/35365] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:10,868 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,869 INFO [Listener at localhost.localdomain/35365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,871 INFO [Listener at localhost.localdomain/35365] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42649 connecting to ZooKeeper ensemble=127.0.0.1:50466 2023-02-16 14:01:10,874 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:426490x0, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:10,876 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:426490x0, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:10,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42649-0x1016b9731080002 connected 2023-02-16 14:01:10,877 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:10,878 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:10,880 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-16 14:01:10,881 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42649 2023-02-16 14:01:10,881 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42649 2023-02-16 14:01:10,883 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-16 14:01:10,883 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42649 2023-02-16 14:01:10,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,886 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:10,886 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,887 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:10,887 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:10,887 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:10,888 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,889 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:10,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,39623,1676556070773 from backup master directory 2023-02-16 14:01:10,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:10,890 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,890 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:10,890 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:10,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/hbase.id with ID: 464e3339-7322-4aef-82d9-542c8cd6281f 2023-02-16 14:01:10,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:10,913 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x049521c7 to 127.0.0.1:50466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:10,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78b54b3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:10,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:10,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:10,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:10,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store-tmp 2023-02-16 14:01:10,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:10,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:10,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:10,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:10,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:10,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:10,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:10,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:10,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/WALs/jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39623%2C1676556070773, suffix=, logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/WALs/jenkins-hbase20.apache.org,39623,1676556070773, archiveDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:10,957 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK] 2023-02-16 14:01:10,958 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK] 2023-02-16 14:01:10,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/WALs/jenkins-hbase20.apache.org,39623,1676556070773/jenkins-hbase20.apache.org%2C39623%2C1676556070773.1676556070942 2023-02-16 14:01:10,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK], DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK]] 2023-02-16 14:01:10,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:10,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:10,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,963 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,964 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:10,964 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:10,965 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:10,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,966 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:10,970 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:10,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62527532, jitterRate=-0.06826716661453247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:10,971 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:10,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:10,972 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:10,972 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:10,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:10,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:10,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:10,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:10,974 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:10,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:10,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:10,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:10,983 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:10,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:10,984 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:10,986 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:10,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:10,987 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:10,988 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:10,988 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:10,988 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:10,988 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,39623,1676556070773, sessionid=0x1016b9731080000, setting cluster-up flag (Was=false) 2023-02-16 14:01:10,992 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,994 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:10,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,996 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:10,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:10,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:10,999 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/.tmp 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:11,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556101004 2023-02-16 14:01:11,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:11,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:11,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:11,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:11,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:11,005 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:11,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:11,005 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:11,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:11,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:11,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:11,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:11,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:11,006 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:11,007 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556071006,5,FailOnTimeoutGroup] 2023-02-16 14:01:11,007 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556071007,5,FailOnTimeoutGroup] 2023-02-16 14:01:11,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:11,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,016 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:11,016 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:11,017 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf 2023-02-16 14:01:11,025 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:11,026 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:11,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/info 2023-02-16 14:01:11,028 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:11,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:11,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:11,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:11,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:11,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/table 2023-02-16 14:01:11,031 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:11,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,032 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740 2023-02-16 14:01:11,032 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740 2023-02-16 14:01:11,034 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:11,035 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:11,036 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:11,037 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74638191, jitterRate=0.11219571530818939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:11,037 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:11,037 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:11,037 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:11,038 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:11,038 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:11,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:11,040 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:11,041 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:11,086 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(952): ClusterId : 464e3339-7322-4aef-82d9-542c8cd6281f 2023-02-16 14:01:11,086 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(952): ClusterId : 464e3339-7322-4aef-82d9-542c8cd6281f 2023-02-16 14:01:11,087 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:11,087 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:11,090 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:11,090 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:11,090 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:11,090 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:11,092 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:11,092 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:11,096 DEBUG [RS:0;jenkins-hbase20:37247] zookeeper.ReadOnlyZKClient(139): Connect 0x23dcfeb7 to 127.0.0.1:50466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:11,096 DEBUG [RS:1;jenkins-hbase20:42649] zookeeper.ReadOnlyZKClient(139): Connect 0x7b93c1e9 to 127.0.0.1:50466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:11,103 DEBUG [RS:0;jenkins-hbase20:37247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d1b04bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:11,103 DEBUG [RS:0;jenkins-hbase20:37247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@292495c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:11,103 DEBUG [RS:1;jenkins-hbase20:42649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755420eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:11,104 DEBUG [RS:1;jenkins-hbase20:42649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@716baa99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:11,112 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:37247 2023-02-16 14:01:11,112 INFO [RS:0;jenkins-hbase20:37247] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:11,112 INFO [RS:0;jenkins-hbase20:37247] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:11,112 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:11,112 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39623,1676556070773 with isa=jenkins-hbase20.apache.org/148.251.75.209:37247, startcode=1676556070823 2023-02-16 14:01:11,113 DEBUG [RS:0;jenkins-hbase20:37247] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:11,113 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:42649 2023-02-16 14:01:11,113 INFO [RS:1;jenkins-hbase20:42649] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:11,113 INFO [RS:1;jenkins-hbase20:42649] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:11,113 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:11,114 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39623,1676556070773 with isa=jenkins-hbase20.apache.org/148.251.75.209:42649, startcode=1676556070856 2023-02-16 14:01:11,114 DEBUG [RS:1;jenkins-hbase20:42649] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:11,114 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51477, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:11,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,117 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52381, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:11,117 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf 2023-02-16 14:01:11,117 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43431 2023-02-16 14:01:11,117 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:11,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,118 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf 2023-02-16 14:01:11,118 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43431 2023-02-16 14:01:11,118 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:11,118 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:11,120 DEBUG [RS:0;jenkins-hbase20:37247] zookeeper.ZKUtil(162): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,120 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42649,1676556070856] 2023-02-16 14:01:11,120 WARN [RS:0;jenkins-hbase20:37247] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:11,120 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37247,1676556070823] 2023-02-16 14:01:11,120 INFO [RS:0;jenkins-hbase20:37247] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:11,120 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,120 DEBUG [RS:1;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,120 WARN [RS:1;jenkins-hbase20:42649] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:11,120 INFO [RS:1;jenkins-hbase20:42649] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:11,120 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,125 DEBUG [RS:1;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,125 DEBUG [RS:0;jenkins-hbase20:37247] zookeeper.ZKUtil(162): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,126 DEBUG [RS:1;jenkins-hbase20:42649] zookeeper.ZKUtil(162): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,126 DEBUG [RS:0;jenkins-hbase20:37247] zookeeper.ZKUtil(162): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,127 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:11,127 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:11,127 INFO [RS:0;jenkins-hbase20:37247] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:11,127 INFO [RS:1;jenkins-hbase20:42649] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:11,128 INFO [RS:0;jenkins-hbase20:37247] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:11,128 INFO [RS:0;jenkins-hbase20:37247] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:11,128 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,128 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:11,130 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,130 INFO [RS:1;jenkins-hbase20:42649] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,130 INFO [RS:1;jenkins-hbase20:42649] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,130 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:11,130 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:11,130 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,131 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,131 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,131 DEBUG [RS:0;jenkins-hbase20:37247] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,132 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,132 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,132 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,132 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,132 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,133 DEBUG [RS:1;jenkins-hbase20:42649] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:11,136 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,136 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,136 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,144 INFO [RS:0;jenkins-hbase20:37247] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:11,144 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37247,1676556070823-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,147 INFO [RS:1;jenkins-hbase20:42649] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:11,147 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42649,1676556070856-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,152 INFO [RS:0;jenkins-hbase20:37247] regionserver.Replication(203): jenkins-hbase20.apache.org,37247,1676556070823 started 2023-02-16 14:01:11,152 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,37247,1676556070823, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37247, sessionid=0x1016b9731080001 2023-02-16 14:01:11,152 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:11,152 DEBUG [RS:0;jenkins-hbase20:37247] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,152 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37247,1676556070823' 2023-02-16 14:01:11,153 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:11,153 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37247,1676556070823' 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:11,154 DEBUG [RS:0;jenkins-hbase20:37247] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:11,154 INFO [RS:0;jenkins-hbase20:37247] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:11,155 INFO [RS:0;jenkins-hbase20:37247] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:11,158 INFO [RS:1;jenkins-hbase20:42649] regionserver.Replication(203): jenkins-hbase20.apache.org,42649,1676556070856 started 2023-02-16 14:01:11,158 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42649,1676556070856, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42649, sessionid=0x1016b9731080002 2023-02-16 14:01:11,158 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:11,158 DEBUG [RS:1;jenkins-hbase20:42649] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,158 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42649,1676556070856' 2023-02-16 14:01:11,158 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42649,1676556070856' 2023-02-16 14:01:11,159 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:11,160 DEBUG [RS:1;jenkins-hbase20:42649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:11,160 DEBUG [RS:1;jenkins-hbase20:42649] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:11,160 INFO [RS:1;jenkins-hbase20:42649] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:11,160 INFO [RS:1;jenkins-hbase20:42649] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:11,192 DEBUG [jenkins-hbase20:39623] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:11,192 DEBUG [jenkins-hbase20:39623] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:11,193 DEBUG [jenkins-hbase20:39623] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:11,193 DEBUG [jenkins-hbase20:39623] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:11,193 DEBUG [jenkins-hbase20:39623] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:11,194 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37247,1676556070823, state=OPENING 2023-02-16 14:01:11,195 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:11,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:11,197 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:11,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37247,1676556070823}] 2023-02-16 14:01:11,352 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:11,352 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:11,354 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56006, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:11,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:11,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:11,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37247%2C1676556070823.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,37247,1676556070823, archiveDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs, maxLogs=32 2023-02-16 14:01:11,378 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK] 2023-02-16 14:01:11,380 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK] 2023-02-16 14:01:11,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,37247,1676556070823/jenkins-hbase20.apache.org%2C37247%2C1676556070823.meta.1676556071362.meta 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK], DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK]] 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:11,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:11,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:11,384 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:11,384 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/info 2023-02-16 14:01:11,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/info 2023-02-16 14:01:11,385 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:11,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:11,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:11,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:11,386 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:11,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:11,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/table 2023-02-16 14:01:11,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/table 2023-02-16 14:01:11,388 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:11,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740 2023-02-16 14:01:11,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740 2023-02-16 14:01:11,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:11,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:11,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72707309, jitterRate=0.08342333137989044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:11,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:11,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556071352 2023-02-16 14:01:11,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:11,401 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:11,401 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37247,1676556070823, state=OPEN 2023-02-16 14:01:11,402 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:11,402 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:11,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:11,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37247,1676556070823 in 205 msec 2023-02-16 14:01:11,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:11,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-16 14:01:11,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 405 msec 2023-02-16 14:01:11,406 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556071406, completionTime=-1 2023-02-16 14:01:11,406 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:11,406 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:11,411 DEBUG [hconnection-0xdd9c9b5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:11,413 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:11,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:11,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556131420 2023-02-16 14:01:11,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556191420 2023-02-16 14:01:11,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 14 msec 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39623,1676556070773-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39623,1676556070773-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39623,1676556070773-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:39623, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:11,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:11,429 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:11,429 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:11,431 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:11,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:11,432 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:11,434 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,435 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b empty. 2023-02-16 14:01:11,435 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,435 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:11,455 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:11,456 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a8c843a8240e39ab2e02e4d2f643239b, NAME => 'hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp 2023-02-16 14:01:11,468 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:11,468 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a8c843a8240e39ab2e02e4d2f643239b, disabling compactions & flushes 2023-02-16 14:01:11,469 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. after waiting 0 ms 2023-02-16 14:01:11,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,469 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a8c843a8240e39ab2e02e4d2f643239b: 2023-02-16 14:01:11,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:11,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556071472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556071472"}]},"ts":"1676556071472"} 2023-02-16 14:01:11,474 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:11,475 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:11,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556071475"}]},"ts":"1676556071475"} 2023-02-16 14:01:11,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:11,479 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:11,480 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:11,480 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:11,480 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:11,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a8c843a8240e39ab2e02e4d2f643239b, ASSIGN}] 2023-02-16 14:01:11,483 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a8c843a8240e39ab2e02e4d2f643239b, ASSIGN 2023-02-16 14:01:11,484 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a8c843a8240e39ab2e02e4d2f643239b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42649,1676556070856; forceNewPlan=false, retain=false 2023-02-16 14:01:11,634 INFO [jenkins-hbase20:39623] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:11,635 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a8c843a8240e39ab2e02e4d2f643239b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,635 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556071635"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556071635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556071635"}]},"ts":"1676556071635"} 2023-02-16 14:01:11,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a8c843a8240e39ab2e02e4d2f643239b, server=jenkins-hbase20.apache.org,42649,1676556070856}] 2023-02-16 14:01:11,790 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,791 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:11,792 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:11,797 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,800 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42649%2C1676556070856, suffix=, logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,42649,1676556070856, archiveDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs, maxLogs=32 2023-02-16 14:01:11,822 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK] 2023-02-16 14:01:11,822 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK] 2023-02-16 14:01:11,827 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,42649,1676556070856/jenkins-hbase20.apache.org%2C42649%2C1676556070856.1676556071800 2023-02-16 14:01:11,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK], DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK]] 2023-02-16 14:01:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a8c843a8240e39ab2e02e4d2f643239b, NAME => 'hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,830 INFO [StoreOpener-a8c843a8240e39ab2e02e4d2f643239b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,831 DEBUG [StoreOpener-a8c843a8240e39ab2e02e4d2f643239b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/info 2023-02-16 14:01:11,832 DEBUG [StoreOpener-a8c843a8240e39ab2e02e4d2f643239b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/info 2023-02-16 14:01:11,832 INFO [StoreOpener-a8c843a8240e39ab2e02e4d2f643239b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8c843a8240e39ab2e02e4d2f643239b columnFamilyName info 2023-02-16 14:01:11,833 INFO [StoreOpener-a8c843a8240e39ab2e02e4d2f643239b-1] regionserver.HStore(310): Store=a8c843a8240e39ab2e02e4d2f643239b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:11,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,836 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:11,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:11,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a8c843a8240e39ab2e02e4d2f643239b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68828708, jitterRate=0.02562767267227173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:11,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a8c843a8240e39ab2e02e4d2f643239b: 2023-02-16 14:01:11,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b., pid=6, masterSystemTime=1676556071790 2023-02-16 14:01:11,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:11,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a8c843a8240e39ab2e02e4d2f643239b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:11,846 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556071845"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556071845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556071845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556071845"}]},"ts":"1676556071845"} 2023-02-16 14:01:11,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:11,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a8c843a8240e39ab2e02e4d2f643239b, server=jenkins-hbase20.apache.org,42649,1676556070856 in 211 msec 2023-02-16 14:01:11,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:11,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a8c843a8240e39ab2e02e4d2f643239b, ASSIGN in 371 msec 2023-02-16 14:01:11,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:11,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556071856"}]},"ts":"1676556071856"} 2023-02-16 14:01:11,859 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:11,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:11,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 433 msec 2023-02-16 14:01:11,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:11,931 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:11,932 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:11,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:11,936 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:11,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:11,947 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:11,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-16 14:01:11,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:11,966 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:11,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-16 14:01:11,973 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:11,974 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:11,974 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.083sec 2023-02-16 14:01:11,974 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:11,974 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:11,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:11,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39623,1676556070773-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:11,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39623,1676556070773-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:11,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:11,986 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ReadOnlyZKClient(139): Connect 0x60073144 to 127.0.0.1:50466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:11,992 DEBUG [Listener at localhost.localdomain/35365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f59a2f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:11,994 DEBUG [hconnection-0x67d09f11-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:11,995 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:11,997 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:11,997 DEBUG [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:12,000 DEBUG [Listener at localhost.localdomain/35365] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:12,002 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:12,002 INFO [Listener at localhost.localdomain/35365] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:12,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:12,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:12,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:54424 deadline: 1676556132003, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:12,004 INFO [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 14:01:12,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:12,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:12,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:12,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-16 14:01:12,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:12,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:12,012 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,012 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 empty. 2023-02-16 14:01:12,013 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,013 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 14:01:12,023 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:12,024 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 828281298d3bd50f013d0bb6855e7dd5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 828281298d3bd50f013d0bb6855e7dd5, disabling compactions & flushes 2023-02-16 14:01:12,033 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. after waiting 0 ms 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,033 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,033 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:12,035 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:12,036 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676556072036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556072036"}]},"ts":"1676556072036"} 2023-02-16 14:01:12,037 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:12,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:12,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556072038"}]},"ts":"1676556072038"} 2023-02-16 14:01:12,039 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-16 14:01:12,042 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:12,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:12,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:12,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:12,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, ASSIGN}] 2023-02-16 14:01:12,045 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, ASSIGN 2023-02-16 14:01:12,046 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37247,1676556070823; forceNewPlan=false, retain=false 2023-02-16 14:01:12,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:12,158 INFO [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37247%2C1676556070823, suffix=, logDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,37247,1676556070823, archiveDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs, maxLogs=32 2023-02-16 14:01:12,176 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK] 2023-02-16 14:01:12,177 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK] 2023-02-16 14:01:12,178 INFO [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,37247,1676556070823/jenkins-hbase20.apache.org%2C37247%2C1676556070823.1676556072159 2023-02-16 14:01:12,179 DEBUG [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36427,DS-b0635d15-f3bf-4b65-8cce-60575ddf75c2,DISK], DatanodeInfoWithStorage[127.0.0.1:33655,DS-5aefd29c-4bad-4fa7-b4c2-781004ad9a34,DISK]] 2023-02-16 14:01:12,196 INFO [jenkins-hbase20:39623] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:12,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=828281298d3bd50f013d0bb6855e7dd5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676556072197"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556072197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556072197"}]},"ts":"1676556072197"} 2023-02-16 14:01:12,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 828281298d3bd50f013d0bb6855e7dd5, server=jenkins-hbase20.apache.org,37247,1676556070823}] 2023-02-16 14:01:12,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:12,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 828281298d3bd50f013d0bb6855e7dd5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,356 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,358 DEBUG [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1 2023-02-16 14:01:12,358 DEBUG [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1 2023-02-16 14:01:12,359 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 828281298d3bd50f013d0bb6855e7dd5 columnFamilyName f1 2023-02-16 14:01:12,359 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] regionserver.HStore(310): Store=828281298d3bd50f013d0bb6855e7dd5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:12,359 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,361 DEBUG [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2 2023-02-16 14:01:12,361 DEBUG [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2 2023-02-16 14:01:12,361 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 828281298d3bd50f013d0bb6855e7dd5 columnFamilyName f2 2023-02-16 14:01:12,362 INFO [StoreOpener-828281298d3bd50f013d0bb6855e7dd5-1] regionserver.HStore(310): Store=828281298d3bd50f013d0bb6855e7dd5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:12,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:12,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:12,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:12,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 828281298d3bd50f013d0bb6855e7dd5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67008537, jitterRate=-0.0014949887990951538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:12,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:12,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5., pid=12, masterSystemTime=1676556072351 2023-02-16 14:01:12,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,374 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=828281298d3bd50f013d0bb6855e7dd5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,374 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676556072374"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556072374"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556072374"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556072374"}]},"ts":"1676556072374"} 2023-02-16 14:01:12,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 14:01:12,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 828281298d3bd50f013d0bb6855e7dd5, server=jenkins-hbase20.apache.org,37247,1676556070823 in 177 msec 2023-02-16 14:01:12,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 14:01:12,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, ASSIGN in 335 msec 2023-02-16 14:01:12,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:12,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556072380"}]},"ts":"1676556072380"} 2023-02-16 14:01:12,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-16 14:01:12,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:12,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 377 msec 2023-02-16 14:01:12,615 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:12,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:12,617 INFO [Listener at localhost.localdomain/35365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-16 14:01:12,617 DEBUG [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-16 14:01:12,618 INFO [Listener at localhost.localdomain/35365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:12,620 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-16 14:01:12,621 INFO [Listener at localhost.localdomain/35365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:12,621 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-16 14:01:12,621 INFO [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:12,683 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37247] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,818 INFO [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:12,818 INFO [Listener at localhost.localdomain/35365] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:12,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 14:01:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556072820 (current time:1676556072820). 2023-02-16 14:01:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] zookeeper.ReadOnlyZKClient(139): Connect 0x4d6d6615 to 127.0.0.1:50466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:12,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3979606e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:12,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:12,833 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d6d6615 to 127.0.0.1:50466 2023-02-16 14:01:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:12,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 14:01:12,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 14:01:12,837 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 14:01:12,838 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676556672838 2023-02-16 14:01:12,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 14:01:12,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:12,839 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:12,840 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 14:01:12,840 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:12,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 14:01:12,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-16 14:01:12,841 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 14:01:12,842 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676556672842 2023-02-16 14:01:12,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 14:01:12,850 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 14:01:12,851 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:12,851 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 14:01:12,851 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 14:01:12,852 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,852 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,853 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:12,853 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:12,853 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:12,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:12,853 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,853 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 14:01:12,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 14:01:12,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 14:01:12,859 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 14:01:12,859 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:12,859 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 14:01:12,860 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 14:01:12,860 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:12,860 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 14:01:12,861 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 14:01:12,861 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 14:01:12,861 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42649,1676556070856' joining acquired barrier for procedure (foo) in zk 2023-02-16 14:01:12,861 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37247,1676556070823' joining acquired barrier for procedure (foo) in zk 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,862 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:12,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,862 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:12,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:12,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:12,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:12,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37247,1676556070823' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 14:01:12,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2455ac68[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:12,866 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 14:01:12,866 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 14:01:12,867 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,867 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:12,867 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,867 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,42649,1676556070856' in zk 2023-02-16 14:01:12,867 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. started... 2023-02-16 14:01:12,868 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 828281298d3bd50f013d0bb6855e7dd5 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 14:01:12,869 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 14:01:12,869 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:12,869 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 14:01:12,885 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f1/3c4a0475560748fcbb114eb331b4b570 2023-02-16 14:01:12,915 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f2/97c2947dd63640c8a8bac9e03504abfc 2023-02-16 14:01:12,921 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f1/3c4a0475560748fcbb114eb331b4b570 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570 2023-02-16 14:01:12,927 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:12,928 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f2/97c2947dd63640c8a8bac9e03504abfc as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc 2023-02-16 14:01:12,940 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 14:01:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:12,941 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:12,942 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:12,942 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 828281298d3bd50f013d0bb6855e7dd5 in 74ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:12,943 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 14:01:12,943 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:12,943 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.' region-info for snapshot=foo 2023-02-16 14:01:12,943 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:12,944 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570] hfiles 2023-02-16 14:01:12,944 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570 for snapshot=foo 2023-02-16 14:01:12,944 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc] hfiles 2023-02-16 14:01:12,944 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc for snapshot=foo 2023-02-16 14:01:12,953 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. completed. 2023-02-16 14:01:12,953 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:12,953 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 14:01:12,953 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 14:01:12,953 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,953 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 14:01:12,953 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,37247,1676556070823' in zk 2023-02-16 14:01:12,954 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,954 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 14:01:12,954 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:12,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:12,954 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 14:01:12,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:12,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:12,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,37247,1676556070823': 2023-02-16 14:01:12,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37247,1676556070823' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 14:01:12,959 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 14:01:12,959 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:12,959 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:12,959 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 14:01:12,959 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:12,961 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:12,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:12,961 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:12,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,962 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,964 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:12,964 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:12,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:12,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,970 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:12,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:12,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:12,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:12,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:12,970 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:12,971 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:12,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:12,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:12,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/foo 2023-02-16 14:01:13,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-16 14:01:13,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:13,012 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:13,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676556072838Consolidate snapshot: foo at 1676556072970 (+132 ms)Loading Region manifests for foo at 1676556072970Writing data manifest for foo at 1676556072974 (+4 ms)Verifying snapshot: foo at 1676556072990 (+16 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676556073012 (+22 ms) 2023-02-16 14:01:13,014 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 14:01:13,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 175 msec 2023-02-16 14:01:13,142 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:13,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 14:01:13,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:13,145 INFO [Listener at localhost.localdomain/35365] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:13,153 INFO [Listener at localhost.localdomain/35365] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:13,161 INFO [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:13,198 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37247] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,327 INFO [Listener at localhost.localdomain/35365] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:13,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:13,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,335 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-16 14:01:13,335 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:13,336 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-16 14:01:13,336 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-16 14:01:13,336 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,337 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,337 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,337 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:13,337 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:13,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:13,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:13,338 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,338 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 14:01:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 14:01:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 14:01:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:13,340 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 14:01:13,340 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:13,340 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 14:01:13,340 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 14:01:13,340 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,340 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42649,1676556070856' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 14:01:13,340 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. started... 2023-02-16 14:01:13,340 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 828281298d3bd50f013d0bb6855e7dd5 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 14:01:13,342 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,342 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,342 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:13,354 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f1/c0d368edb8db4c75ada0283718be7502 2023-02-16 14:01:13,376 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f2/6e5f4113f00a4d7097d9ac598b1ab9e1 2023-02-16 14:01:13,381 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f1/c0d368edb8db4c75ada0283718be7502 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/c0d368edb8db4c75ada0283718be7502 2023-02-16 14:01:13,385 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/c0d368edb8db4c75ada0283718be7502, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:13,386 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/.tmp/f2/6e5f4113f00a4d7097d9ac598b1ab9e1 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/6e5f4113f00a4d7097d9ac598b1ab9e1 2023-02-16 14:01:13,391 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/6e5f4113f00a4d7097d9ac598b1ab9e1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:13,392 INFO [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 828281298d3bd50f013d0bb6855e7dd5 in 52ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:13,393 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:13,393 DEBUG [rs(jenkins-hbase20.apache.org,37247,1676556070823)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,393 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 14:01:13,393 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 14:01:13,393 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,393 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 14:01:13,393 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37247,1676556070823' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 14:01:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,395 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:13,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37247,1676556070823' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-16 14:01:13,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@206a2c3a[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:13,397 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-16 14:01:13,397 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,397 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 14:01:13,397 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,397 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:13,397 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 14:01:13,397 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 14:01:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 14:01:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,37247,1676556070823' in zk 2023-02-16 14:01:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,42649,1676556070856' in zk 2023-02-16 14:01:13,399 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 14:01:13,399 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:13,399 DEBUG [member: 'jenkins-hbase20.apache.org,37247,1676556070823' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 14:01:13,399 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 14:01:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,42649,1676556070856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 14:01:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:13,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase20.apache.org,37247,1676556070823': 2023-02-16 14:01:13,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37247,1676556070823' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-16 14:01:13,405 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-16 14:01:13,405 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:13,405 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:13,405 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,405 INFO [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:13,406 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:13,406 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:13,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:13,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:13,406 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:13,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:13,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,407 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:13,408 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,408 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,409 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:13,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:13,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:13,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-16 14:01:13,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:13,410 DEBUG [(jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:13,410 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:13,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:13,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:13,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:13,411 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,511 DEBUG [Listener at localhost.localdomain/35365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:13,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:13,524 INFO [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676556072820 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:13,524 DEBUG [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:43431/user/jenkins/test-data/08cb89a5-24a6-c1e3-5508-b4cab4b310b7/foo/c7dd3d6b-9b88-4572-b995-1913a68d2c07/data/default/testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,525 INFO [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(239): region to add: 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:13,525 INFO [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(585): clone region=828281298d3bd50f013d0bb6855e7dd5 as 828281298d3bd50f013d0bb6855e7dd5 in snapshot foo 2023-02-16 14:01:13,525 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 828281298d3bd50f013d0bb6855e7dd5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43431/user/jenkins/test-data/08cb89a5-24a6-c1e3-5508-b4cab4b310b7/foo/c7dd3d6b-9b88-4572-b995-1913a68d2c07 2023-02-16 14:01:13,532 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:13,533 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c4a0475560748fcbb114eb331b4b570 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,535 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97c2947dd63640c8a8bac9e03504abfc from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 828281298d3bd50f013d0bb6855e7dd5, disabling compactions & flushes 2023-02-16 14:01:13,538 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. after waiting 0 ms 2023-02-16 14:01:13,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,538 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:13,538 INFO [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676556072820 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:13,538 DEBUG [Listener at localhost.localdomain/35365] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:43431/user/jenkins/test-data/08cb89a5-24a6-c1e3-5508-b4cab4b310b7/foo/c7dd3d6b-9b88-4572-b995-1913a68d2c07 2023-02-16 14:01:13,538 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:43431/user/jenkins/test-data/08cb89a5-24a6-c1e3-5508-b4cab4b310b7/foo/c7dd3d6b-9b88-4572-b995-1913a68d2c07 2023-02-16 14:01:13,539 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:13,540 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:13,540 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-16 14:01:13,541 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |----------828281298d3bd50f013d0bb6855e7dd5/ 2023-02-16 14:01:13,541 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:13,541 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:13,542 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=828281298d3bd50f013d0bb6855e7dd5-3c4a0475560748fcbb114eb331b4b570 2023-02-16 14:01:13,542 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:13,542 DEBUG [Listener at localhost.localdomain/35365] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=828281298d3bd50f013d0bb6855e7dd5-97c2947dd63640c8a8bac9e03504abfc 2023-02-16 14:01:13,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-16 14:01:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 14:01:13,548 INFO [Listener at localhost.localdomain/35365] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:13,555 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556073554"}]},"ts":"1676556073554"} 2023-02-16 14:01:13,556 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-16 14:01:13,557 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-16 14:01:13,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, UNASSIGN}] 2023-02-16 14:01:13,560 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, UNASSIGN 2023-02-16 14:01:13,561 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=828281298d3bd50f013d0bb6855e7dd5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,561 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676556073561"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556073561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556073561"}]},"ts":"1676556073561"} 2023-02-16 14:01:13,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 828281298d3bd50f013d0bb6855e7dd5, server=jenkins-hbase20.apache.org,37247,1676556070823}] 2023-02-16 14:01:13,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:13,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:13,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 828281298d3bd50f013d0bb6855e7dd5, disabling compactions & flushes 2023-02-16 14:01:13,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. after waiting 0 ms 2023-02-16 14:01:13,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:13,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5. 2023-02-16 14:01:13,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 828281298d3bd50f013d0bb6855e7dd5: 2023-02-16 14:01:13,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:13,724 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=828281298d3bd50f013d0bb6855e7dd5, regionState=CLOSED 2023-02-16 14:01:13,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676556073724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556073724"}]},"ts":"1676556073724"} 2023-02-16 14:01:13,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 14:01:13,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 828281298d3bd50f013d0bb6855e7dd5, server=jenkins-hbase20.apache.org,37247,1676556070823 in 172 msec 2023-02-16 14:01:13,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 14:01:13,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=828281298d3bd50f013d0bb6855e7dd5, UNASSIGN in 179 msec 2023-02-16 14:01:13,739 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556073739"}]},"ts":"1676556073739"} 2023-02-16 14:01:13,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-16 14:01:13,741 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-16 14:01:13,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 193 msec 2023-02-16 14:01:13,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:13,858 INFO [Listener at localhost.localdomain/35365] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-16 14:01:13,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,863 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:13,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:13,873 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1, FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2, FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/recovered.edits] 2023-02-16 14:01:13,877 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570 to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/archive/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/3c4a0475560748fcbb114eb331b4b570 2023-02-16 14:01:13,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/c0d368edb8db4c75ada0283718be7502 to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/archive/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f1/c0d368edb8db4c75ada0283718be7502 2023-02-16 14:01:13,882 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/6e5f4113f00a4d7097d9ac598b1ab9e1 to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/archive/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/6e5f4113f00a4d7097d9ac598b1ab9e1 2023-02-16 14:01:13,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/archive/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/f2/97c2947dd63640c8a8bac9e03504abfc 2023-02-16 14:01:13,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/recovered.edits/12.seqid to hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/archive/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5/recovered.edits/12.seqid 2023-02-16 14:01:13,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/828281298d3bd50f013d0bb6855e7dd5 2023-02-16 14:01:13,886 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 14:01:13,889 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,890 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-16 14:01:13,892 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-16 14:01:13,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-16 14:01:13,894 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556073894"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:13,895 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 14:01:13,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 828281298d3bd50f013d0bb6855e7dd5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676556072006.828281298d3bd50f013d0bb6855e7dd5.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 14:01:13,896 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-16 14:01:13,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556073896"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:13,899 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-16 14:01:13,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 14:01:13,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 41 msec 2023-02-16 14:01:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:13,968 INFO [Listener at localhost.localdomain/35365] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-16 14:01:13,968 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:13,968 INFO [Listener at localhost.localdomain/35365] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:13,969 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60073144 to 127.0.0.1:50466 2023-02-16 14:01:13,969 DEBUG [Listener at localhost.localdomain/35365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:13,969 DEBUG [Listener at localhost.localdomain/35365] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:13,969 DEBUG [Listener at localhost.localdomain/35365] util.JVMClusterUtil(257): Found active master hash=1171141783, stopped=false 2023-02-16 14:01:13,970 INFO [Listener at localhost.localdomain/35365] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:13,971 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:13,971 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:13,971 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:13,971 INFO [Listener at localhost.localdomain/35365] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:13,971 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:13,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:13,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:13,973 DEBUG [Listener at localhost.localdomain/35365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049521c7 to 127.0.0.1:50466 2023-02-16 14:01:13,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:13,973 DEBUG [Listener at localhost.localdomain/35365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:13,973 INFO [Listener at localhost.localdomain/35365] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,37247,1676556070823' ***** 2023-02-16 14:01:13,974 INFO [Listener at localhost.localdomain/35365] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:13,974 INFO [Listener at localhost.localdomain/35365] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42649,1676556070856' ***** 2023-02-16 14:01:13,974 INFO [Listener at localhost.localdomain/35365] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:13,974 INFO [RS:0;jenkins-hbase20:37247] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:13,974 INFO [RS:1;jenkins-hbase20:42649] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:13,975 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:13,975 INFO [RS:0;jenkins-hbase20:37247] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:13,976 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:13,976 INFO [RS:0;jenkins-hbase20:37247] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:13,976 INFO [RS:1;jenkins-hbase20:42649] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:13,977 INFO [RS:1;jenkins-hbase20:42649] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:13,976 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:13,978 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(3304): Received CLOSE for a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:13,978 DEBUG [RS:0;jenkins-hbase20:37247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23dcfeb7 to 127.0.0.1:50466 2023-02-16 14:01:13,978 DEBUG [RS:0;jenkins-hbase20:37247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:13,978 INFO [RS:0;jenkins-hbase20:37247] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:13,978 INFO [RS:0;jenkins-hbase20:37247] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:13,978 INFO [RS:0;jenkins-hbase20:37247] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:13,978 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:13,978 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:13,978 DEBUG [RS:1;jenkins-hbase20:42649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b93c1e9 to 127.0.0.1:50466 2023-02-16 14:01:13,978 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 14:01:13,979 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 14:01:13,979 DEBUG [RS:1;jenkins-hbase20:42649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:13,979 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 14:01:13,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a8c843a8240e39ab2e02e4d2f643239b, disabling compactions & flushes 2023-02-16 14:01:13,979 DEBUG [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 14:01:13,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:13,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:13,979 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1479): Online Regions={a8c843a8240e39ab2e02e4d2f643239b=hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b.} 2023-02-16 14:01:13,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:13,980 DEBUG [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1505): Waiting on a8c843a8240e39ab2e02e4d2f643239b 2023-02-16 14:01:13,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:13,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:13,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. after waiting 0 ms 2023-02-16 14:01:13,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:13,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:13,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:13,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing a8c843a8240e39ab2e02e4d2f643239b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:13,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-16 14:01:13,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/info/d7239c34240c4635be7f3a7efd84f7e2 2023-02-16 14:01:13,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/.tmp/info/db4d8108fcb647c08b51d3a0cff8707a 2023-02-16 14:01:13,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7239c34240c4635be7f3a7efd84f7e2 2023-02-16 14:01:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/.tmp/info/db4d8108fcb647c08b51d3a0cff8707a as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/info/db4d8108fcb647c08b51d3a0cff8707a 2023-02-16 14:01:14,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/info/db4d8108fcb647c08b51d3a0cff8707a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:14,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a8c843a8240e39ab2e02e4d2f643239b in 28ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:14,011 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/rep_barrier/66746eb6239f4832b7639c9266eb2885 2023-02-16 14:01:14,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/namespace/a8c843a8240e39ab2e02e4d2f643239b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:14,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:14,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a8c843a8240e39ab2e02e4d2f643239b: 2023-02-16 14:01:14,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556071428.a8c843a8240e39ab2e02e4d2f643239b. 2023-02-16 14:01:14,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66746eb6239f4832b7639c9266eb2885 2023-02-16 14:01:14,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/table/c3d9385e27614958969909a749ae20d6 2023-02-16 14:01:14,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3d9385e27614958969909a749ae20d6 2023-02-16 14:01:14,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/info/d7239c34240c4635be7f3a7efd84f7e2 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/info/d7239c34240c4635be7f3a7efd84f7e2 2023-02-16 14:01:14,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7239c34240c4635be7f3a7efd84f7e2 2023-02-16 14:01:14,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/info/d7239c34240c4635be7f3a7efd84f7e2, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 14:01:14,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/rep_barrier/66746eb6239f4832b7639c9266eb2885 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/rep_barrier/66746eb6239f4832b7639c9266eb2885 2023-02-16 14:01:14,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66746eb6239f4832b7639c9266eb2885 2023-02-16 14:01:14,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/rep_barrier/66746eb6239f4832b7639c9266eb2885, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 14:01:14,038 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/.tmp/table/c3d9385e27614958969909a749ae20d6 as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/table/c3d9385e27614958969909a749ae20d6 2023-02-16 14:01:14,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3d9385e27614958969909a749ae20d6 2023-02-16 14:01:14,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/table/c3d9385e27614958969909a749ae20d6, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 14:01:14,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4345, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=21, compaction requested=false 2023-02-16 14:01:14,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 14:01:14,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:14,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:14,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:14,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:14,063 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:14,063 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:14,134 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 14:01:14,134 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 14:01:14,136 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 14:01:14,137 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 14:01:14,179 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,37247,1676556070823; all regions closed. 2023-02-16 14:01:14,180 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42649,1676556070856; all regions closed. 2023-02-16 14:01:14,187 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/WALs/jenkins-hbase20.apache.org,42649,1676556070856/jenkins-hbase20.apache.org%2C42649%2C1676556070856.1676556071800 not finished, retry = 0 2023-02-16 14:01:14,189 DEBUG [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs 2023-02-16 14:01:14,189 INFO [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37247%2C1676556070823.meta:.meta(num 1676556071362) 2023-02-16 14:01:14,194 DEBUG [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs 2023-02-16 14:01:14,195 INFO [RS:0;jenkins-hbase20:37247] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37247%2C1676556070823:(num 1676556072159) 2023-02-16 14:01:14,195 DEBUG [RS:0;jenkins-hbase20:37247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:14,195 INFO [RS:0;jenkins-hbase20:37247] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:14,195 INFO [RS:0;jenkins-hbase20:37247] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:14,195 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:14,196 INFO [RS:0;jenkins-hbase20:37247] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37247 2023-02-16 14:01:14,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:14,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:14,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37247,1676556070823 2023-02-16 14:01:14,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:14,197 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43eb038b rejected from java.util.concurrent.ThreadPoolExecutor@47d48f2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,197 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:14,197 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@287213a0 rejected from java.util.concurrent.ThreadPoolExecutor@47d48f2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,198 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37247,1676556070823] 2023-02-16 14:01:14,198 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37247,1676556070823; numProcessing=1 2023-02-16 14:01:14,198 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,37247,1676556070823 already deleted, retry=false 2023-02-16 14:01:14,198 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37247,1676556070823 expired; onlineServers=1 2023-02-16 14:01:14,292 DEBUG [RS:1;jenkins-hbase20:42649] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/oldWALs 2023-02-16 14:01:14,293 INFO [RS:1;jenkins-hbase20:42649] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42649%2C1676556070856:(num 1676556071800) 2023-02-16 14:01:14,293 DEBUG [RS:1;jenkins-hbase20:42649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:14,293 INFO [RS:1;jenkins-hbase20:42649] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:14,293 INFO [RS:1;jenkins-hbase20:42649] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:14,294 INFO [RS:1;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:14,294 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:14,294 INFO [RS:1;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:14,294 INFO [RS:1;jenkins-hbase20:42649] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:14,296 INFO [RS:1;jenkins-hbase20:42649] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42649 2023-02-16 14:01:14,297 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42649,1676556070856 2023-02-16 14:01:14,297 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:14,297 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e1a361a rejected from java.util.concurrent.ThreadPoolExecutor@a25a301[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,298 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42649,1676556070856] 2023-02-16 14:01:14,298 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42649,1676556070856; numProcessing=2 2023-02-16 14:01:14,299 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42649,1676556070856 already deleted, retry=false 2023-02-16 14:01:14,299 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42649,1676556070856 expired; onlineServers=0 2023-02-16 14:01:14,299 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39623,1676556070773' ***** 2023-02-16 14:01:14,299 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:14,300 DEBUG [M:0;jenkins-hbase20:39623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f1b8f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:14,300 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39623,1676556070773 2023-02-16 14:01:14,300 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39623,1676556070773; all regions closed. 2023-02-16 14:01:14,300 DEBUG [M:0;jenkins-hbase20:39623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:14,300 DEBUG [M:0;jenkins-hbase20:39623] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:14,300 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:14,300 DEBUG [M:0;jenkins-hbase20:39623] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:14,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556071006] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556071006,5,FailOnTimeoutGroup] 2023-02-16 14:01:14,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556071007] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556071007,5,FailOnTimeoutGroup] 2023-02-16 14:01:14,301 INFO [M:0;jenkins-hbase20:39623] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:14,303 INFO [M:0;jenkins-hbase20:39623] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:14,303 INFO [M:0;jenkins-hbase20:39623] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:14,303 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:14,303 DEBUG [M:0;jenkins-hbase20:39623] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:14,303 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:14,303 INFO [M:0;jenkins-hbase20:39623] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:14,304 ERROR [M:0;jenkins-hbase20:39623] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:14,304 INFO [M:0;jenkins-hbase20:39623] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:14,304 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:14,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:14,305 DEBUG [M:0;jenkins-hbase20:39623] zookeeper.ZKUtil(398): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:14,305 WARN [M:0;jenkins-hbase20:39623] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:14,305 INFO [M:0;jenkins-hbase20:39623] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:14,306 INFO [M:0;jenkins-hbase20:39623] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:14,306 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:14,306 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:14,306 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:14,307 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:14,307 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:14,307 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.88 KB 2023-02-16 14:01:14,319 INFO [M:0;jenkins-hbase20:39623] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d2ef56597159454599f3be39ba757c3b 2023-02-16 14:01:14,323 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d2ef56597159454599f3be39ba757c3b as hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d2ef56597159454599f3be39ba757c3b 2023-02-16 14:01:14,327 INFO [M:0;jenkins-hbase20:39623] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43431/user/jenkins/test-data/27260218-6554-c64d-c005-b75c841abacf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d2ef56597159454599f3be39ba757c3b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 14:01:14,327 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57266, heapSize ~66.87 KB/68472, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-16 14:01:14,328 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:14,328 DEBUG [M:0;jenkins-hbase20:39623] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:14,331 INFO [M:0;jenkins-hbase20:39623] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:14,331 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:14,331 INFO [M:0;jenkins-hbase20:39623] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39623 2023-02-16 14:01:14,332 DEBUG [M:0;jenkins-hbase20:39623] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,39623,1676556070773 already deleted, retry=false 2023-02-16 14:01:14,376 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,376 INFO [RS:0;jenkins-hbase20:37247] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,37247,1676556070823; zookeeper connection closed. 2023-02-16 14:01:14,377 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50d0eedc rejected from java.util.concurrent.ThreadPoolExecutor@47d48f2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,379 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d2f3f5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d2f3f5 2023-02-16 14:01:14,379 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:37247-0x1016b9731080001, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,379 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a2e1613 rejected from java.util.concurrent.ThreadPoolExecutor@47d48f2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,477 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,477 INFO [M:0;jenkins-hbase20:39623] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39623,1676556070773; zookeeper connection closed. 2023-02-16 14:01:14,477 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@278a6eb4 rejected from java.util.concurrent.ThreadPoolExecutor@23b5ee9d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,477 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): master:39623-0x1016b9731080000, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,478 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2310e759 rejected from java.util.concurrent.ThreadPoolExecutor@23b5ee9d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,577 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,577 INFO [RS:1;jenkins-hbase20:42649] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42649,1676556070856; zookeeper connection closed. 2023-02-16 14:01:14,577 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2157fbf4 rejected from java.util.concurrent.ThreadPoolExecutor@a25a301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,578 DEBUG [Listener at localhost.localdomain/35365-EventThread] zookeeper.ZKWatcher(600): regionserver:42649-0x1016b9731080002, quorum=127.0.0.1:50466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:14,578 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@698380f1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@698380f1 2023-02-16 14:01:14,578 ERROR [Listener at localhost.localdomain/35365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59382a5c rejected from java.util.concurrent.ThreadPoolExecutor@a25a301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:14,578 INFO [Listener at localhost.localdomain/35365] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:14,579 WARN [Listener at localhost.localdomain/35365] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:14,588 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:14,693 WARN [BP-188849739-148.251.75.209-1676556070144 heartbeating to localhost.localdomain/127.0.0.1:43431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:14,694 WARN [BP-188849739-148.251.75.209-1676556070144 heartbeating to localhost.localdomain/127.0.0.1:43431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-188849739-148.251.75.209-1676556070144 (Datanode Uuid b716f55b-320a-4cfd-8459-9392de7654c8) service to localhost.localdomain/127.0.0.1:43431 2023-02-16 14:01:14,694 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/dfs/data/data3/current/BP-188849739-148.251.75.209-1676556070144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:14,695 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/dfs/data/data4/current/BP-188849739-148.251.75.209-1676556070144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:14,698 WARN [Listener at localhost.localdomain/35365] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:14,703 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:14,816 WARN [BP-188849739-148.251.75.209-1676556070144 heartbeating to localhost.localdomain/127.0.0.1:43431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:14,816 WARN [BP-188849739-148.251.75.209-1676556070144 heartbeating to localhost.localdomain/127.0.0.1:43431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-188849739-148.251.75.209-1676556070144 (Datanode Uuid a38882c1-0e00-470f-88dc-c9c4ca65e9cb) service to localhost.localdomain/127.0.0.1:43431 2023-02-16 14:01:14,817 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/dfs/data/data1/current/BP-188849739-148.251.75.209-1676556070144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:14,818 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/cluster_58e3ba8f-9638-a7a3-46ea-19409f9f990c/dfs/data/data2/current/BP-188849739-148.251.75.209-1676556070144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:14,832 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:14,954 INFO [Listener at localhost.localdomain/35365] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:14,980 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:15,010 INFO [Listener at localhost.localdomain/35365] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 159) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/35365 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost.localdomain:43431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:43431 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-3-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost.localdomain:43431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:43431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:43431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,39623,1676556070773)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:43431 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:43431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=572 (was 539) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 309), ProcessCount=166 (was 166), AvailableMemoryMB=3124 (was 3205) 2023-02-16 14:01:15,019 INFO [Listener at localhost.localdomain/35365] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=572, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=166, AvailableMemoryMB=3124 2023-02-16 14:01:15,027 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.log.dir so I do NOT create it in target/test-data/e953faea-2015-7523-e90d-241af3de124c 2023-02-16 14:01:15,027 WARN [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:15,027 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.tmp.dir so I do NOT create it in target/test-data/e953faea-2015-7523-e90d-241af3de124c 2023-02-16 14:01:15,027 WARN [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/972f9508-fcdd-7cc8-57c5-25bbbf8dfd0c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:15,027 DEBUG [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2, deleteOnExit=true 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/test.cache.data in system properties and HBase conf 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:15,028 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:15,028 DEBUG [Listener at localhost.localdomain/35365] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:15,029 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:15,030 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:15,030 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:15,030 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:15,030 INFO [Listener at localhost.localdomain/35365] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:15,032 WARN [Listener at localhost.localdomain/35365] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:15,033 WARN [Listener at localhost.localdomain/35365] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:15,054 WARN [Listener at localhost.localdomain/35365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:15,056 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:15,061 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/java.io.tmpdir/Jetty_localhost_localdomain_38679_hdfs____o6nf8t/webapp 2023-02-16 14:01:15,134 INFO [Listener at localhost.localdomain/35365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38679 2023-02-16 14:01:15,137 WARN [Listener at localhost.localdomain/35365] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:15,137 WARN [Listener at localhost.localdomain/35365] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:15,186 WARN [Listener at localhost.localdomain/40625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:15,199 WARN [Listener at localhost.localdomain/40625] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:15,201 WARN [Listener at localhost.localdomain/40625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:15,202 INFO [Listener at localhost.localdomain/40625] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:15,211 INFO [Listener at localhost.localdomain/40625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/java.io.tmpdir/Jetty_localhost_44609_datanode____e99fae/webapp 2023-02-16 14:01:15,291 INFO [Listener at localhost.localdomain/40625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44609 2023-02-16 14:01:15,299 WARN [Listener at localhost.localdomain/44593] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:15,310 WARN [Listener at localhost.localdomain/44593] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:15,312 WARN [Listener at localhost.localdomain/44593] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:15,313 INFO [Listener at localhost.localdomain/44593] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:15,317 INFO [Listener at localhost.localdomain/44593] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/java.io.tmpdir/Jetty_localhost_46091_datanode____ofuf71/webapp 2023-02-16 14:01:15,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1e799f8c2731b8e4: Processing first storage report for DS-956aae84-1823-46d8-8807-ff248863d413 from datanode 4c2b03f4-a309-48d9-912c-ff4337f6b297 2023-02-16 14:01:15,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1e799f8c2731b8e4: from storage DS-956aae84-1823-46d8-8807-ff248863d413 node DatanodeRegistration(127.0.0.1:45857, datanodeUuid=4c2b03f4-a309-48d9-912c-ff4337f6b297, infoPort=44219, infoSecurePort=0, ipcPort=44593, storageInfo=lv=-57;cid=testClusterID;nsid=909264503;c=1676556075034), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:15,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1e799f8c2731b8e4: Processing first storage report for DS-7f4f7ed0-55f1-4da3-96b5-dc7b91b97baf from datanode 4c2b03f4-a309-48d9-912c-ff4337f6b297 2023-02-16 14:01:15,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1e799f8c2731b8e4: from storage DS-7f4f7ed0-55f1-4da3-96b5-dc7b91b97baf node DatanodeRegistration(127.0.0.1:45857, datanodeUuid=4c2b03f4-a309-48d9-912c-ff4337f6b297, infoPort=44219, infoSecurePort=0, ipcPort=44593, storageInfo=lv=-57;cid=testClusterID;nsid=909264503;c=1676556075034), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:15,406 INFO [Listener at localhost.localdomain/44593] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46091 2023-02-16 14:01:15,414 WARN [Listener at localhost.localdomain/36913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:15,485 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc74cea166d110e11: Processing first storage report for DS-701773e1-3739-4ca9-b020-072fae67c1f1 from datanode 7a3ac34c-e3b5-4415-9c5b-c9ffeb70929e 2023-02-16 14:01:15,485 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc74cea166d110e11: from storage DS-701773e1-3739-4ca9-b020-072fae67c1f1 node DatanodeRegistration(127.0.0.1:45011, datanodeUuid=7a3ac34c-e3b5-4415-9c5b-c9ffeb70929e, infoPort=46851, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=909264503;c=1676556075034), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:15,485 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc74cea166d110e11: Processing first storage report for DS-e66dc1e6-2c5b-452b-9ac5-22750c0859e0 from datanode 7a3ac34c-e3b5-4415-9c5b-c9ffeb70929e 2023-02-16 14:01:15,485 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc74cea166d110e11: from storage DS-e66dc1e6-2c5b-452b-9ac5-22750c0859e0 node DatanodeRegistration(127.0.0.1:45011, datanodeUuid=7a3ac34c-e3b5-4415-9c5b-c9ffeb70929e, infoPort=46851, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=909264503;c=1676556075034), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:15,522 DEBUG [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c 2023-02-16 14:01:15,525 INFO [Listener at localhost.localdomain/36913] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/zookeeper_0, clientPort=50483, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:15,526 INFO [Listener at localhost.localdomain/36913] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50483 2023-02-16 14:01:15,526 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,527 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,562 INFO [Listener at localhost.localdomain/36913] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4 with version=8 2023-02-16 14:01:15,562 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,563 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,564 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/hbase-staging 2023-02-16 14:01:15,566 INFO [Listener at localhost.localdomain/36913] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:15,567 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,567 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,567 INFO [Listener at localhost.localdomain/36913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:15,567 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,568 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:15,568 INFO [Listener at localhost.localdomain/36913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:15,569 INFO [Listener at localhost.localdomain/36913] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42445 2023-02-16 14:01:15,569 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,571 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,572 INFO [Listener at localhost.localdomain/36913] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42445 connecting to ZooKeeper ensemble=127.0.0.1:50483 2023-02-16 14:01:15,587 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:424450x0, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:15,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42445-0x1016b9743b30000 connected 2023-02-16 14:01:15,658 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:15,659 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:15,660 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:15,667 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42445 2023-02-16 14:01:15,667 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42445 2023-02-16 14:01:15,671 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42445 2023-02-16 14:01:15,677 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42445 2023-02-16 14:01:15,678 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42445 2023-02-16 14:01:15,678 INFO [Listener at localhost.localdomain/36913] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4, hbase.cluster.distributed=false 2023-02-16 14:01:15,690 INFO [Listener at localhost.localdomain/36913] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:15,691 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,691 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,692 INFO [Listener at localhost.localdomain/36913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:15,692 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,692 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:15,692 INFO [Listener at localhost.localdomain/36913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:15,693 INFO [Listener at localhost.localdomain/36913] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41653 2023-02-16 14:01:15,694 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:15,696 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:15,696 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,698 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,699 INFO [Listener at localhost.localdomain/36913] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41653 connecting to ZooKeeper ensemble=127.0.0.1:50483 2023-02-16 14:01:15,704 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:416530x0, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:15,705 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:416530x0, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:15,705 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:416530x0, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:15,706 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:416530x0, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:15,709 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41653 2023-02-16 14:01:15,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41653-0x1016b9743b30001 connected 2023-02-16 14:01:15,710 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41653 2023-02-16 14:01:15,711 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41653 2023-02-16 14:01:15,712 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41653 2023-02-16 14:01:15,712 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41653 2023-02-16 14:01:15,726 INFO [Listener at localhost.localdomain/36913] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:15,726 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,727 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,727 INFO [Listener at localhost.localdomain/36913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:15,727 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:15,727 INFO [Listener at localhost.localdomain/36913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:15,727 INFO [Listener at localhost.localdomain/36913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:15,731 INFO [Listener at localhost.localdomain/36913] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46265 2023-02-16 14:01:15,731 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:15,733 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:15,734 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,736 INFO [Listener at localhost.localdomain/36913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,738 INFO [Listener at localhost.localdomain/36913] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46265 connecting to ZooKeeper ensemble=127.0.0.1:50483 2023-02-16 14:01:15,750 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:462650x0, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:15,751 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:462650x0, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:15,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46265-0x1016b9743b30002 connected 2023-02-16 14:01:15,752 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:15,753 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:15,758 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46265 2023-02-16 14:01:15,758 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46265 2023-02-16 14:01:15,759 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46265 2023-02-16 14:01:15,759 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46265 2023-02-16 14:01:15,760 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46265 2023-02-16 14:01:15,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,764 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:15,764 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,765 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:15,765 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:15,765 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:15,767 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:15,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,42445,1676556075566 from backup master directory 2023-02-16 14:01:15,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:15,769 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,769 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:15,769 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:15,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,785 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/hbase.id with ID: e677cd0b-985e-4890-9ba7-52dfc49ac9ca 2023-02-16 14:01:15,794 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:15,796 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2af5f614 to 127.0.0.1:50483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:15,811 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4907c617, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:15,811 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:15,811 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:15,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:15,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store-tmp 2023-02-16 14:01:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:15,820 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:15,820 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:15,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:15,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/WALs/jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42445%2C1676556075566, suffix=, logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/WALs/jenkins-hbase20.apache.org,42445,1676556075566, archiveDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:15,836 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK] 2023-02-16 14:01:15,836 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK] 2023-02-16 14:01:15,843 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/WALs/jenkins-hbase20.apache.org,42445,1676556075566/jenkins-hbase20.apache.org%2C42445%2C1676556075566.1676556075823 2023-02-16 14:01:15,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK], DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK]] 2023-02-16 14:01:15,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:15,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:15,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,845 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,847 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:15,847 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:15,847 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:15,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,850 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:15,855 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:15,855 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65901562, jitterRate=-0.017990201711654663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:15,855 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:15,856 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:15,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:15,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:15,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:15,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:15,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:15,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:15,858 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:15,859 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:15,868 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:15,868 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:15,869 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:15,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:15,869 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:15,870 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:15,871 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:15,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:15,872 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:15,872 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:15,872 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:15,872 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,42445,1676556075566, sessionid=0x1016b9743b30000, setting cluster-up flag (Was=false) 2023-02-16 14:01:15,877 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,879 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:15,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,883 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:15,886 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:15,887 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:15,888 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/.tmp 2023-02-16 14:01:15,895 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:15,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:15,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556105907 2023-02-16 14:01:15,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:15,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:15,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:15,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:15,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:15,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:15,908 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:15,908 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:15,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:15,909 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:15,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:15,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:15,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:15,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:15,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:15,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556075921,5,FailOnTimeoutGroup] 2023-02-16 14:01:15,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556075922,5,FailOnTimeoutGroup] 2023-02-16 14:01:15,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:15,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:15,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:15,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:15,934 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:15,935 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:15,935 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4 2023-02-16 14:01:15,947 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:15,949 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:15,952 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/info 2023-02-16 14:01:15,952 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:15,953 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:15,953 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:15,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:15,955 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:15,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:15,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:15,957 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/table 2023-02-16 14:01:15,958 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:15,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:15,960 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740 2023-02-16 14:01:15,961 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740 2023-02-16 14:01:15,961 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(952): ClusterId : e677cd0b-985e-4890-9ba7-52dfc49ac9ca 2023-02-16 14:01:15,961 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:15,963 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:15,964 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:15,964 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:15,965 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(952): ClusterId : e677cd0b-985e-4890-9ba7-52dfc49ac9ca 2023-02-16 14:01:15,965 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:15,966 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:15,968 DEBUG [RS:0;jenkins-hbase20:41653] zookeeper.ReadOnlyZKClient(139): Connect 0x4a216ba4 to 127.0.0.1:50483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:15,970 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:15,970 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:15,972 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:15,977 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:15,995 DEBUG [RS:1;jenkins-hbase20:46265] zookeeper.ReadOnlyZKClient(139): Connect 0x0abcb96c to 127.0.0.1:50483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:15,998 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:15,999 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61933440, jitterRate=-0.07711982727050781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:15,999 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:15,999 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:15,999 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:15,999 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:16,000 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:16,000 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:16,003 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:16,003 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:16,004 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:16,004 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:16,004 DEBUG [RS:0;jenkins-hbase20:41653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44e68c90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:16,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:16,004 DEBUG [RS:0;jenkins-hbase20:41653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d900d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:16,004 DEBUG [RS:1;jenkins-hbase20:46265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b564b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:16,005 DEBUG [RS:1;jenkins-hbase20:46265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44d21c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:16,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:16,023 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:46265 2023-02-16 14:01:16,023 INFO [RS:1;jenkins-hbase20:46265] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:16,023 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:41653 2023-02-16 14:01:16,023 INFO [RS:1;jenkins-hbase20:46265] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:16,023 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:16,024 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:16,024 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,42445,1676556075566 with isa=jenkins-hbase20.apache.org/148.251.75.209:46265, startcode=1676556075725 2023-02-16 14:01:16,023 INFO [RS:0;jenkins-hbase20:41653] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:16,024 INFO [RS:0;jenkins-hbase20:41653] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:16,024 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:16,024 DEBUG [RS:1;jenkins-hbase20:46265] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:16,024 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,42445,1676556075566 with isa=jenkins-hbase20.apache.org/148.251.75.209:41653, startcode=1676556075690 2023-02-16 14:01:16,025 DEBUG [RS:0;jenkins-hbase20:41653] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:16,027 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33807, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:16,027 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53513, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:16,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42445] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,029 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4 2023-02-16 14:01:16,030 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40625 2023-02-16 14:01:16,030 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4 2023-02-16 14:01:16,030 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:16,030 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40625 2023-02-16 14:01:16,030 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:16,032 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:16,032 DEBUG [RS:1;jenkins-hbase20:46265] zookeeper.ZKUtil(162): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,032 DEBUG [RS:0;jenkins-hbase20:41653] zookeeper.ZKUtil(162): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,033 WARN [RS:1;jenkins-hbase20:46265] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:16,033 WARN [RS:0;jenkins-hbase20:41653] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:16,033 INFO [RS:1;jenkins-hbase20:46265] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:16,033 INFO [RS:0;jenkins-hbase20:41653] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:16,033 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,033 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,033 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46265,1676556075725] 2023-02-16 14:01:16,033 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41653,1676556075690] 2023-02-16 14:01:16,043 DEBUG [RS:0;jenkins-hbase20:41653] zookeeper.ZKUtil(162): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,043 DEBUG [RS:1;jenkins-hbase20:46265] zookeeper.ZKUtil(162): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,043 DEBUG [RS:0;jenkins-hbase20:41653] zookeeper.ZKUtil(162): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,043 DEBUG [RS:1;jenkins-hbase20:46265] zookeeper.ZKUtil(162): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,044 DEBUG [RS:0;jenkins-hbase20:41653] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:16,044 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:16,044 INFO [RS:0;jenkins-hbase20:41653] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:16,044 INFO [RS:1;jenkins-hbase20:46265] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:16,047 INFO [RS:0;jenkins-hbase20:41653] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:16,063 INFO [RS:1;jenkins-hbase20:46265] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:16,063 INFO [RS:0;jenkins-hbase20:41653] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:16,063 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,063 INFO [RS:1;jenkins-hbase20:46265] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:16,063 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,065 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:16,065 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:16,068 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,068 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:0;jenkins-hbase20:41653] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,068 DEBUG [RS:1;jenkins-hbase20:46265] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:16,075 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,076 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,076 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,076 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,076 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,076 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,085 INFO [RS:0;jenkins-hbase20:41653] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:16,085 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41653,1676556075690-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,089 INFO [RS:1;jenkins-hbase20:46265] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:16,089 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46265,1676556075725-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,099 INFO [RS:0;jenkins-hbase20:41653] regionserver.Replication(203): jenkins-hbase20.apache.org,41653,1676556075690 started 2023-02-16 14:01:16,099 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41653,1676556075690, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41653, sessionid=0x1016b9743b30001 2023-02-16 14:01:16,099 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:16,099 DEBUG [RS:0;jenkins-hbase20:41653] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,099 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41653,1676556075690' 2023-02-16 14:01:16,099 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:16,099 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41653,1676556075690' 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:16,100 DEBUG [RS:0;jenkins-hbase20:41653] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:16,100 INFO [RS:0;jenkins-hbase20:41653] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:16,100 INFO [RS:0;jenkins-hbase20:41653] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:16,103 INFO [RS:1;jenkins-hbase20:46265] regionserver.Replication(203): jenkins-hbase20.apache.org,46265,1676556075725 started 2023-02-16 14:01:16,103 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,46265,1676556075725, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46265, sessionid=0x1016b9743b30002 2023-02-16 14:01:16,103 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:16,103 DEBUG [RS:1;jenkins-hbase20:46265] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,103 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46265,1676556075725' 2023-02-16 14:01:16,103 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:16,103 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46265,1676556075725' 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:16,104 DEBUG [RS:1;jenkins-hbase20:46265] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:16,104 INFO [RS:1;jenkins-hbase20:46265] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:16,104 INFO [RS:1;jenkins-hbase20:46265] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:16,174 DEBUG [jenkins-hbase20:42445] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:16,174 DEBUG [jenkins-hbase20:42445] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:16,176 DEBUG [jenkins-hbase20:42445] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:16,176 DEBUG [jenkins-hbase20:42445] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:16,176 DEBUG [jenkins-hbase20:42445] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:16,177 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46265,1676556075725, state=OPENING 2023-02-16 14:01:16,178 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:16,179 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:16,179 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:16,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:16,334 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,334 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:16,335 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51140, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:16,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:16,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:16,342 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46265%2C1676556075725.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,46265,1676556075725, archiveDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs, maxLogs=32 2023-02-16 14:01:16,359 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK] 2023-02-16 14:01:16,361 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK] 2023-02-16 14:01:16,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,46265,1676556075725/jenkins-hbase20.apache.org%2C46265%2C1676556075725.meta.1676556076342.meta 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK], DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK]] 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:16,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:16,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:16,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:16,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/info 2023-02-16 14:01:16,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/info 2023-02-16 14:01:16,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:16,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:16,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:16,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:16,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:16,374 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:16,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:16,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:16,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/table 2023-02-16 14:01:16,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/table 2023-02-16 14:01:16,378 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:16,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:16,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740 2023-02-16 14:01:16,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740 2023-02-16 14:01:16,383 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:16,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:16,387 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75219914, jitterRate=0.12086406350135803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:16,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:16,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556076334 2023-02-16 14:01:16,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:16,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:16,395 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46265,1676556075725, state=OPEN 2023-02-16 14:01:16,396 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:16,397 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:16,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:16,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46265,1676556075725 in 216 msec 2023-02-16 14:01:16,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:16,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 395 msec 2023-02-16 14:01:16,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 510 msec 2023-02-16 14:01:16,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556076405, completionTime=-1 2023-02-16 14:01:16,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:16,405 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:16,408 DEBUG [hconnection-0x1f7ff8a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:16,409 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:16,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:16,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556136410 2023-02-16 14:01:16,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556196410 2023-02-16 14:01:16,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42445,1676556075566-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42445,1676556075566-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42445,1676556075566-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:42445, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:16,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:16,416 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:16,417 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:16,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:16,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:16,419 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/hbase/namespace/98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/hbase/namespace/98908a39744cead65d12521d9c157a21 empty. 2023-02-16 14:01:16,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/hbase/namespace/98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,420 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:16,434 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:16,435 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 98908a39744cead65d12521d9c157a21, NAME => 'hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:16,443 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:16,443 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 98908a39744cead65d12521d9c157a21, disabling compactions & flushes 2023-02-16 14:01:16,444 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,444 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,444 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. after waiting 0 ms 2023-02-16 14:01:16,444 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,444 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,444 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 98908a39744cead65d12521d9c157a21: 2023-02-16 14:01:16,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:16,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556076447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556076447"}]},"ts":"1676556076447"} 2023-02-16 14:01:16,449 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:16,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:16,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556076450"}]},"ts":"1676556076450"} 2023-02-16 14:01:16,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:16,454 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:16,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:16,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:16,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:16,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=98908a39744cead65d12521d9c157a21, ASSIGN}] 2023-02-16 14:01:16,461 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=98908a39744cead65d12521d9c157a21, ASSIGN 2023-02-16 14:01:16,462 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=98908a39744cead65d12521d9c157a21, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:16,612 INFO [jenkins-hbase20:42445] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:16,613 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=98908a39744cead65d12521d9c157a21, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556076613"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556076613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556076613"}]},"ts":"1676556076613"} 2023-02-16 14:01:16,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 98908a39744cead65d12521d9c157a21, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:16,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,773 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46265%2C1676556075725, suffix=, logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,46265,1676556075725, archiveDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs, maxLogs=32 2023-02-16 14:01:16,786 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK] 2023-02-16 14:01:16,788 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK] 2023-02-16 14:01:16,790 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,46265,1676556075725/jenkins-hbase20.apache.org%2C46265%2C1676556075725.1676556076773 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK], DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK]] 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 98908a39744cead65d12521d9c157a21, NAME => 'hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,794 INFO [StoreOpener-98908a39744cead65d12521d9c157a21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,796 DEBUG [StoreOpener-98908a39744cead65d12521d9c157a21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/info 2023-02-16 14:01:16,796 DEBUG [StoreOpener-98908a39744cead65d12521d9c157a21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/info 2023-02-16 14:01:16,796 INFO [StoreOpener-98908a39744cead65d12521d9c157a21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98908a39744cead65d12521d9c157a21 columnFamilyName info 2023-02-16 14:01:16,797 INFO [StoreOpener-98908a39744cead65d12521d9c157a21-1] regionserver.HStore(310): Store=98908a39744cead65d12521d9c157a21/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,798 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:16,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:16,802 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 98908a39744cead65d12521d9c157a21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69627690, jitterRate=0.03753343224525452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:16,802 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 98908a39744cead65d12521d9c157a21: 2023-02-16 14:01:16,803 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21., pid=6, masterSystemTime=1676556076768 2023-02-16 14:01:16,805 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,806 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:16,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=98908a39744cead65d12521d9c157a21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:16,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556076806"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556076806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556076806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556076806"}]},"ts":"1676556076806"} 2023-02-16 14:01:16,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:16,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 98908a39744cead65d12521d9c157a21, server=jenkins-hbase20.apache.org,46265,1676556075725 in 196 msec 2023-02-16 14:01:16,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:16,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=98908a39744cead65d12521d9c157a21, ASSIGN in 361 msec 2023-02-16 14:01:16,817 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:16,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556076818"}]},"ts":"1676556076818"} 2023-02-16 14:01:16,820 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:16,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:16,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 409 msec 2023-02-16 14:01:16,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:16,919 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:16,919 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:16,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:16,933 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:16,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-16 14:01:16,945 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:16,952 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:16,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-16 14:01:16,961 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:16,962 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:16,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.193sec 2023-02-16 14:01:16,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:16,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:16,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:16,963 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42445,1676556075566-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:16,963 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42445,1676556075566-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:16,964 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:16,965 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ReadOnlyZKClient(139): Connect 0x0af03bf1 to 127.0.0.1:50483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:16,977 DEBUG [Listener at localhost.localdomain/36913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d3e5426, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:16,980 DEBUG [hconnection-0x7eddb9a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:16,983 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51154, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:16,984 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:16,985 DEBUG [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:16,988 DEBUG [Listener at localhost.localdomain/36913] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:16,992 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35884, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:16,993 INFO [Listener at localhost.localdomain/36913] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 14:01:16,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-16 14:01:16,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:16,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 148.251.75.209:35884 deadline: 1676556136994, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,007 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-16 14:01:17,010 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:17,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,014 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:17,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-16 14:01:17,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:17,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,023 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d empty. 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,024 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 empty. 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 empty. 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,025 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,025 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 14:01:17,033 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:17,034 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 32ca3410ed35806b37e5de13b4622ee1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,034 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7ee377f65c38a8311d41824adcb4ff6d, NAME => 'testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,034 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 25ab5f37bedd95ae6d36dd6bf14f9717, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 25ab5f37bedd95ae6d36dd6bf14f9717, disabling compactions & flushes 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,040 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 32ca3410ed35806b37e5de13b4622ee1, disabling compactions & flushes 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 7ee377f65c38a8311d41824adcb4ff6d, disabling compactions & flushes 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,040 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,040 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. after waiting 0 ms 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. after waiting 0 ms 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. after waiting 0 ms 2023-02-16 14:01:17,041 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,041 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,041 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,041 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 07dff6e55f0571c845b653956f2fc6a6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 672696ba9762e944cbc5dfa3e0af94ba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 10219cf33b5d182877af26f759faa073, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 10219cf33b5d182877af26f759faa073, disabling compactions & flushes 2023-02-16 14:01:17,048 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. after waiting 0 ms 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,048 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:17,049 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0b887a0c3c4a8f324e39e0a9538dfd63, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 07dff6e55f0571c845b653956f2fc6a6, disabling compactions & flushes 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 672696ba9762e944cbc5dfa3e0af94ba, disabling compactions & flushes 2023-02-16 14:01:17,049 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,049 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. after waiting 0 ms 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. after waiting 0 ms 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,050 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,050 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:17,050 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:17,051 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e68a616bb5f1cc7106cae3ac97003f84, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,051 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 181ea4cd2422c7d97e61580629b5006d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 0b887a0c3c4a8f324e39e0a9538dfd63, disabling compactions & flushes 2023-02-16 14:01:17,055 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. after waiting 0 ms 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:17,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2968bc552d8abb227ebb88a44a7f7f07, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 181ea4cd2422c7d97e61580629b5006d, disabling compactions & flushes 2023-02-16 14:01:17,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. after waiting 0 ms 2023-02-16 14:01:17,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:17,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,058 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e68a616bb5f1cc7106cae3ac97003f84, disabling compactions & flushes 2023-02-16 14:01:17,058 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,058 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,058 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. after waiting 0 ms 2023-02-16 14:01:17,058 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,058 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,058 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 2968bc552d8abb227ebb88a44a7f7f07, disabling compactions & flushes 2023-02-16 14:01:17,064 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. after waiting 0 ms 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,064 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:17,066 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556077067"}]},"ts":"1676556077067"} 2023-02-16 14:01:17,069 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 14:01:17,070 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:17,070 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556077070"}]},"ts":"1676556077070"} 2023-02-16 14:01:17,071 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-16 14:01:17,073 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:17,079 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:17,079 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:17,079 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:17,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, ASSIGN}] 2023-02-16 14:01:17,083 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, ASSIGN 2023-02-16 14:01:17,083 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, ASSIGN 2023-02-16 14:01:17,083 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, ASSIGN 2023-02-16 14:01:17,083 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, ASSIGN 2023-02-16 14:01:17,084 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41653,1676556075690; forceNewPlan=false, retain=false 2023-02-16 14:01:17,084 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:17,084 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:17,084 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41653,1676556075690; forceNewPlan=false, retain=false 2023-02-16 14:01:17,084 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, ASSIGN 2023-02-16 14:01:17,085 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, ASSIGN 2023-02-16 14:01:17,085 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, ASSIGN 2023-02-16 14:01:17,085 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, ASSIGN 2023-02-16 14:01:17,086 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, ASSIGN 2023-02-16 14:01:17,086 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41653,1676556075690; forceNewPlan=false, retain=false 2023-02-16 14:01:17,086 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:17,087 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:17,087 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46265,1676556075725; forceNewPlan=false, retain=false 2023-02-16 14:01:17,087 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, ASSIGN 2023-02-16 14:01:17,087 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41653,1676556075690; forceNewPlan=false, retain=false 2023-02-16 14:01:17,088 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41653,1676556075690; forceNewPlan=false, retain=false 2023-02-16 14:01:17,102 INFO [RS:0;jenkins-hbase20:41653] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41653%2C1676556075690, suffix=, logDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,41653,1676556075690, archiveDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs, maxLogs=32 2023-02-16 14:01:17,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:17,120 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK] 2023-02-16 14:01:17,121 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK] 2023-02-16 14:01:17,124 INFO [RS:0;jenkins-hbase20:41653] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,41653,1676556075690/jenkins-hbase20.apache.org%2C41653%2C1676556075690.1676556077103 2023-02-16 14:01:17,124 DEBUG [RS:0;jenkins-hbase20:41653] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45011,DS-701773e1-3739-4ca9-b020-072fae67c1f1,DISK], DatanodeInfoWithStorage[127.0.0.1:45857,DS-956aae84-1823-46d8-8807-ff248863d413,DISK]] 2023-02-16 14:01:17,234 INFO [jenkins-hbase20:42445] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 14:01:17,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07dff6e55f0571c845b653956f2fc6a6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e68a616bb5f1cc7106cae3ac97003f84, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7ee377f65c38a8311d41824adcb4ff6d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077242"}]},"ts":"1676556077242"} 2023-02-16 14:01:17,242 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077242"}]},"ts":"1676556077242"} 2023-02-16 14:01:17,242 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0b887a0c3c4a8f324e39e0a9538dfd63, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=32ca3410ed35806b37e5de13b4622ee1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,242 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077242"}]},"ts":"1676556077242"} 2023-02-16 14:01:17,242 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077242"}]},"ts":"1676556077242"} 2023-02-16 14:01:17,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077242"}]},"ts":"1676556077242"} 2023-02-16 14:01:17,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 7ee377f65c38a8311d41824adcb4ff6d, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:17,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure e68a616bb5f1cc7106cae3ac97003f84, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:17,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 0b887a0c3c4a8f324e39e0a9538dfd63, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:17,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 07dff6e55f0571c845b653956f2fc6a6, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:17,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 32ca3410ed35806b37e5de13b4622ee1, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:17,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=25ab5f37bedd95ae6d36dd6bf14f9717, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077247"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077247"}]},"ts":"1676556077247"} 2023-02-16 14:01:17,251 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=181ea4cd2422c7d97e61580629b5006d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,251 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077251"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077251"}]},"ts":"1676556077251"} 2023-02-16 14:01:17,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure 25ab5f37bedd95ae6d36dd6bf14f9717, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:17,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=10219cf33b5d182877af26f759faa073, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077252"}]},"ts":"1676556077252"} 2023-02-16 14:01:17,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 181ea4cd2422c7d97e61580629b5006d, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:17,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=672696ba9762e944cbc5dfa3e0af94ba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077255"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077255"}]},"ts":"1676556077255"} 2023-02-16 14:01:17,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 10219cf33b5d182877af26f759faa073, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:17,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2968bc552d8abb227ebb88a44a7f7f07, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 672696ba9762e944cbc5dfa3e0af94ba, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:17,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077257"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556077257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556077257"}]},"ts":"1676556077257"} 2023-02-16 14:01:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 2968bc552d8abb227ebb88a44a7f7f07, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:17,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:17,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e68a616bb5f1cc7106cae3ac97003f84, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 14:01:17,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,402 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,403 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1 2023-02-16 14:01:17,403 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1 2023-02-16 14:01:17,404 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e68a616bb5f1cc7106cae3ac97003f84 columnFamilyName f1 2023-02-16 14:01:17,404 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(310): Store=e68a616bb5f1cc7106cae3ac97003f84/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,404 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,406 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2 2023-02-16 14:01:17,406 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,406 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2 2023-02-16 14:01:17,406 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:17,406 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e68a616bb5f1cc7106cae3ac97003f84 columnFamilyName f2 2023-02-16 14:01:17,407 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(310): Store=e68a616bb5f1cc7106cae3ac97003f84/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,408 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:17,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 181ea4cd2422c7d97e61580629b5006d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 14:01:17,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:17,414 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,416 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1 2023-02-16 14:01:17,416 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1 2023-02-16 14:01:17,416 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181ea4cd2422c7d97e61580629b5006d columnFamilyName f1 2023-02-16 14:01:17,417 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(310): Store=181ea4cd2422c7d97e61580629b5006d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,417 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,418 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2 2023-02-16 14:01:17,418 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2 2023-02-16 14:01:17,419 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181ea4cd2422c7d97e61580629b5006d columnFamilyName f2 2023-02-16 14:01:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,419 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(310): Store=181ea4cd2422c7d97e61580629b5006d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e68a616bb5f1cc7106cae3ac97003f84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70059028, jitterRate=0.04396086931228638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:17,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84., pid=22, masterSystemTime=1676556077396 2023-02-16 14:01:17,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:17,423 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e68a616bb5f1cc7106cae3ac97003f84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 32ca3410ed35806b37e5de13b4622ee1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 14:01:17,423 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077422"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077422"}]},"ts":"1676556077422"} 2023-02-16 14:01:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,426 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,427 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1 2023-02-16 14:01:17,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-16 14:01:17,427 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1 2023-02-16 14:01:17,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure e68a616bb5f1cc7106cae3ac97003f84, server=jenkins-hbase20.apache.org,46265,1676556075725 in 179 msec 2023-02-16 14:01:17,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 181ea4cd2422c7d97e61580629b5006d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69175150, jitterRate=0.030790060758590698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:17,427 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32ca3410ed35806b37e5de13b4622ee1 columnFamilyName f1 2023-02-16 14:01:17,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d., pid=27, masterSystemTime=1676556077406 2023-02-16 14:01:17,428 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(310): Store=32ca3410ed35806b37e5de13b4622ee1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, ASSIGN in 347 msec 2023-02-16 14:01:17,428 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,431 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2 2023-02-16 14:01:17,431 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2 2023-02-16 14:01:17,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=181ea4cd2422c7d97e61580629b5006d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,431 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32ca3410ed35806b37e5de13b4622ee1 columnFamilyName f2 2023-02-16 14:01:17,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077431"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077431"}]},"ts":"1676556077431"} 2023-02-16 14:01:17,432 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(310): Store=32ca3410ed35806b37e5de13b4622ee1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-16 14:01:17,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 181ea4cd2422c7d97e61580629b5006d, server=jenkins-hbase20.apache.org,41653,1676556075690 in 179 msec 2023-02-16 14:01:17,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, ASSIGN in 354 msec 2023-02-16 14:01:17,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 25ab5f37bedd95ae6d36dd6bf14f9717, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 14:01:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:17,438 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 32ca3410ed35806b37e5de13b4622ee1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68922246, jitterRate=0.02702149748802185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:17,439 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1 2023-02-16 14:01:17,439 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1 2023-02-16 14:01:17,439 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ab5f37bedd95ae6d36dd6bf14f9717 columnFamilyName f1 2023-02-16 14:01:17,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1., pid=25, masterSystemTime=1676556077396 2023-02-16 14:01:17,440 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(310): Store=25ab5f37bedd95ae6d36dd6bf14f9717/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,440 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,441 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2 2023-02-16 14:01:17,441 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0b887a0c3c4a8f324e39e0a9538dfd63, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 14:01:17,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=32ca3410ed35806b37e5de13b4622ee1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,441 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ab5f37bedd95ae6d36dd6bf14f9717 columnFamilyName f2 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077441"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077441"}]},"ts":"1676556077441"} 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,442 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(310): Store=25ab5f37bedd95ae6d36dd6bf14f9717/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,443 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,444 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1 2023-02-16 14:01:17,444 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1 2023-02-16 14:01:17,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-16 14:01:17,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 32ca3410ed35806b37e5de13b4622ee1, server=jenkins-hbase20.apache.org,46265,1676556075725 in 196 msec 2023-02-16 14:01:17,444 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b887a0c3c4a8f324e39e0a9538dfd63 columnFamilyName f1 2023-02-16 14:01:17,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,445 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(310): Store=0b887a0c3c4a8f324e39e0a9538dfd63/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,445 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, ASSIGN in 364 msec 2023-02-16 14:01:17,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:17,446 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2 2023-02-16 14:01:17,446 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2 2023-02-16 14:01:17,446 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b887a0c3c4a8f324e39e0a9538dfd63 columnFamilyName f2 2023-02-16 14:01:17,447 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(310): Store=0b887a0c3c4a8f324e39e0a9538dfd63/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 25ab5f37bedd95ae6d36dd6bf14f9717; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66290498, jitterRate=-0.012194603681564331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717., pid=26, masterSystemTime=1676556077406 2023-02-16 14:01:17,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 10219cf33b5d182877af26f759faa073, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 14:01:17,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=25ab5f37bedd95ae6d36dd6bf14f9717, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077450"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077450"}]},"ts":"1676556077450"} 2023-02-16 14:01:17,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:17,452 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,453 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1 2023-02-16 14:01:17,453 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1 2023-02-16 14:01:17,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0b887a0c3c4a8f324e39e0a9538dfd63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67561438, jitterRate=0.006743878126144409}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:17,454 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10219cf33b5d182877af26f759faa073 columnFamilyName f1 2023-02-16 14:01:17,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63., pid=23, masterSystemTime=1676556077396 2023-02-16 14:01:17,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-16 14:01:17,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure 25ab5f37bedd95ae6d36dd6bf14f9717, server=jenkins-hbase20.apache.org,41653,1676556075690 in 202 msec 2023-02-16 14:01:17,454 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(310): Store=10219cf33b5d182877af26f759faa073/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,454 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, ASSIGN in 374 msec 2023-02-16 14:01:17,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ee377f65c38a8311d41824adcb4ff6d, NAME => 'testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 14:01:17,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0b887a0c3c4a8f324e39e0a9538dfd63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,456 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077455"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077455"}]},"ts":"1676556077455"} 2023-02-16 14:01:17,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,457 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,459 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f1 2023-02-16 14:01:17,459 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f1 2023-02-16 14:01:17,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-16 14:01:17,459 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2 2023-02-16 14:01:17,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 0b887a0c3c4a8f324e39e0a9538dfd63, server=jenkins-hbase20.apache.org,46265,1676556075725 in 212 msec 2023-02-16 14:01:17,459 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2 2023-02-16 14:01:17,459 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ee377f65c38a8311d41824adcb4ff6d columnFamilyName f1 2023-02-16 14:01:17,459 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10219cf33b5d182877af26f759faa073 columnFamilyName f2 2023-02-16 14:01:17,460 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(310): Store=7ee377f65c38a8311d41824adcb4ff6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,460 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(310): Store=10219cf33b5d182877af26f759faa073/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,460 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, ASSIGN in 379 msec 2023-02-16 14:01:17,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,461 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f2 2023-02-16 14:01:17,461 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f2 2023-02-16 14:01:17,462 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ee377f65c38a8311d41824adcb4ff6d columnFamilyName f2 2023-02-16 14:01:17,463 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(310): Store=7ee377f65c38a8311d41824adcb4ff6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:17,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 10219cf33b5d182877af26f759faa073; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73709238, jitterRate=0.09835323691368103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:17,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073., pid=28, masterSystemTime=1676556077406 2023-02-16 14:01:17,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:17,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=10219cf33b5d182877af26f759faa073, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 672696ba9762e944cbc5dfa3e0af94ba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 14:01:17,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077469"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077469"}]},"ts":"1676556077469"} 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7ee377f65c38a8311d41824adcb4ff6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61325778, jitterRate=-0.08617469668388367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:17,470 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d., pid=21, masterSystemTime=1676556077396 2023-02-16 14:01:17,472 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1 2023-02-16 14:01:17,472 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1 2023-02-16 14:01:17,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-16 14:01:17,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 10219cf33b5d182877af26f759faa073, server=jenkins-hbase20.apache.org,41653,1676556075690 in 214 msec 2023-02-16 14:01:17,473 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672696ba9762e944cbc5dfa3e0af94ba columnFamilyName f1 2023-02-16 14:01:17,473 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(310): Store=672696ba9762e944cbc5dfa3e0af94ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,473 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,474 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7ee377f65c38a8311d41824adcb4ff6d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,474 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077474"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077474"}]},"ts":"1676556077474"} 2023-02-16 14:01:17,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 07dff6e55f0571c845b653956f2fc6a6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 14:01:17,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, ASSIGN in 392 msec 2023-02-16 14:01:17,477 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,477 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2 2023-02-16 14:01:17,477 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2 2023-02-16 14:01:17,477 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672696ba9762e944cbc5dfa3e0af94ba columnFamilyName f2 2023-02-16 14:01:17,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-16 14:01:17,478 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1 2023-02-16 14:01:17,479 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1 2023-02-16 14:01:17,479 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(310): Store=672696ba9762e944cbc5dfa3e0af94ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 7ee377f65c38a8311d41824adcb4ff6d, server=jenkins-hbase20.apache.org,46265,1676556075725 in 232 msec 2023-02-16 14:01:17,479 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dff6e55f0571c845b653956f2fc6a6 columnFamilyName f1 2023-02-16 14:01:17,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,480 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(310): Store=07dff6e55f0571c845b653956f2fc6a6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,480 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, ASSIGN in 399 msec 2023-02-16 14:01:17,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,481 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2 2023-02-16 14:01:17,481 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2 2023-02-16 14:01:17,482 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dff6e55f0571c845b653956f2fc6a6 columnFamilyName f2 2023-02-16 14:01:17,482 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(310): Store=07dff6e55f0571c845b653956f2fc6a6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:17,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 672696ba9762e944cbc5dfa3e0af94ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61573725, jitterRate=-0.08247999846935272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:17,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba., pid=29, masterSystemTime=1676556077406 2023-02-16 14:01:17,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:17,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2968bc552d8abb227ebb88a44a7f7f07, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 14:01:17,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:17,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,491 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=672696ba9762e944cbc5dfa3e0af94ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,491 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077491"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077491"}]},"ts":"1676556077491"} 2023-02-16 14:01:17,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 07dff6e55f0571c845b653956f2fc6a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70888590, jitterRate=0.056322306394577026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:17,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6., pid=24, masterSystemTime=1676556077396 2023-02-16 14:01:17,492 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,493 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f1 2023-02-16 14:01:17,493 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f1 2023-02-16 14:01:17,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07dff6e55f0571c845b653956f2fc6a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,494 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2968bc552d8abb227ebb88a44a7f7f07 columnFamilyName f1 2023-02-16 14:01:17,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556077494"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077494"}]},"ts":"1676556077494"} 2023-02-16 14:01:17,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-16 14:01:17,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 672696ba9762e944cbc5dfa3e0af94ba, server=jenkins-hbase20.apache.org,41653,1676556075690 in 234 msec 2023-02-16 14:01:17,494 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(310): Store=2968bc552d8abb227ebb88a44a7f7f07/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,495 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, ASSIGN in 414 msec 2023-02-16 14:01:17,497 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f2 2023-02-16 14:01:17,497 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f2 2023-02-16 14:01:17,497 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2968bc552d8abb227ebb88a44a7f7f07 columnFamilyName f2 2023-02-16 14:01:17,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-16 14:01:17,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 07dff6e55f0571c845b653956f2fc6a6, server=jenkins-hbase20.apache.org,46265,1676556075725 in 250 msec 2023-02-16 14:01:17,498 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(310): Store=2968bc552d8abb227ebb88a44a7f7f07/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:17,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, ASSIGN in 417 msec 2023-02-16 14:01:17,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:17,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:17,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:17,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 2968bc552d8abb227ebb88a44a7f7f07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60558367, jitterRate=-0.09761001169681549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:17,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:17,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07., pid=30, masterSystemTime=1676556077406 2023-02-16 14:01:17,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2968bc552d8abb227ebb88a44a7f7f07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556077514"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556077514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556077514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556077514"}]},"ts":"1676556077514"} 2023-02-16 14:01:17,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-16 14:01:17,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 2968bc552d8abb227ebb88a44a7f7f07, server=jenkins-hbase20.apache.org,41653,1676556075690 in 256 msec 2023-02-16 14:01:17,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-16 14:01:17,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, ASSIGN in 438 msec 2023-02-16 14:01:17,521 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:17,521 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556077521"}]},"ts":"1676556077521"} 2023-02-16 14:01:17,522 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-16 14:01:17,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:17,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 515 msec 2023-02-16 14:01:17,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:17,622 INFO [Listener at localhost.localdomain/36913] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-16 14:01:17,622 DEBUG [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-16 14:01:17,622 INFO [Listener at localhost.localdomain/36913] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:17,626 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-16 14:01:17,626 INFO [Listener at localhost.localdomain/36913] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:17,626 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-16 14:01:17,626 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:17,661 DEBUG [hconnection-0x7eddb9a8-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:17,669 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,671 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43130, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:17,676 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,728 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:17,728 INFO [Listener at localhost.localdomain/36913] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:17,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 14:01:17,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556077730 (current time:1676556077730). 2023-02-16 14:01:17,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:17,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] zookeeper.ReadOnlyZKClient(139): Connect 0x6a2f1b7f to 127.0.0.1:50483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:17,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@108e59cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:17,737 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:17,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a2f1b7f to 127.0.0.1:50483 2023-02-16 14:01:17,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 14:01:17,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 14:01:17,741 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 14:01:17,741 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676556677741 2023-02-16 14:01:17,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 14:01:17,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,742 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:17,742 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:17,743 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 14:01:17,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 14:01:17,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-16 14:01:17,745 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 14:01:17,746 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676556677746 2023-02-16 14:01:17,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,760 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 14:01:17,760 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:17,761 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 14:01:17,761 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 14:01:17,761 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,761 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,762 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,762 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:17,762 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:17,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:17,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:17,762 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,762 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,763 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,763 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 14:01:17,763 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:17,763 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 14:01:17,765 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:01:17,766 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 14:01:17,765 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:17,766 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41653,1676556075690' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 14:01:17,766 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:01:17,766 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 14:01:17,766 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46265,1676556075725' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 14:01:17,768 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,768 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:17,769 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,769 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,769 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,769 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:17,769 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,769 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46265,1676556075725' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c8f110b[Count = 1] remaining members to acquire global barrier 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41653,1676556075690' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 14:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c8f110b[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:17,771 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 14:01:17,771 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,772 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:17,772 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:17,772 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:17,772 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,772 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:17,772 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:17,772 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. started... 2023-02-16 14:01:17,774 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0b887a0c3c4a8f324e39e0a9538dfd63 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,775 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:01:17,775 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. started... 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. started... 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. started... 2023-02-16 14:01:17,776 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 181ea4cd2422c7d97e61580629b5006d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. started... 2023-02-16 14:01:17,776 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e68a616bb5f1cc7106cae3ac97003f84 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:01:17,775 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 14:01:17,777 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:17,775 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. started... 2023-02-16 14:01:17,777 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:17,776 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 10219cf33b5d182877af26f759faa073 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,777 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 07dff6e55f0571c845b653956f2fc6a6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,777 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,778 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,778 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:17,778 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:17,791 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. completed. 2023-02-16 14:01:17,791 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:17,791 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,791 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:01:17,791 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. started... 2023-02-16 14:01:17,792 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 672696ba9762e944cbc5dfa3e0af94ba 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,805 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f1/205f9ce6804e4722961fca9089a9d6d4 2023-02-16 14:01:17,807 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f1/4eaaf59acc334965967ef3b548a819e8 2023-02-16 14:01:17,808 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f1/3731e58758fa46f5906c3c2b99915308 2023-02-16 14:01:17,810 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f1/cb6cc0d1975045f2b513d58d7e23969e 2023-02-16 14:01:17,814 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f1/a7eb08a9a06545568a00f4fd250fbd7b 2023-02-16 14:01:17,814 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f1/405b5fd71af54452a5272f50127d2f13 2023-02-16 14:01:17,843 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:17,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:17,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:17,845 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:17,847 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f2/317cc4a504b3492dac11f3873a5850ba 2023-02-16 14:01:17,849 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f2/6a9d7c4cbfb34116b642c10e41dab3d0 2023-02-16 14:01:17,854 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f2/9f31957bb328473fbe0d0bbc90313a0e 2023-02-16 14:01:17,855 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f2/6e4365f0bac24766b4c4f20d60ccccaa 2023-02-16 14:01:17,855 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f1/205f9ce6804e4722961fca9089a9d6d4 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4 2023-02-16 14:01:17,857 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f2/9dbc86e83bb14df5b683bfbee5c54e41 2023-02-16 14:01:17,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:17,860 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f1/4eaaf59acc334965967ef3b548a819e8 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8 2023-02-16 14:01:17,861 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f2/ed9d8e7507ca4842b05287e633153017 2023-02-16 14:01:17,870 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f1/3731e58758fa46f5906c3c2b99915308 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308 2023-02-16 14:01:17,872 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f1/405b5fd71af54452a5272f50127d2f13 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13 2023-02-16 14:01:17,872 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,875 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f2/317cc4a504b3492dac11f3873a5850ba as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba 2023-02-16 14:01:17,876 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f1/cb6cc0d1975045f2b513d58d7e23969e as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e 2023-02-16 14:01:17,878 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f1/a7eb08a9a06545568a00f4fd250fbd7b as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b 2023-02-16 14:01:17,880 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,881 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f2/9f31957bb328473fbe0d0bbc90313a0e as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e 2023-02-16 14:01:17,882 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,882 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:17,883 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,883 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f2/6e4365f0bac24766b4c4f20d60ccccaa as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa 2023-02-16 14:01:17,884 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f2/9dbc86e83bb14df5b683bfbee5c54e41 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41 2023-02-16 14:01:17,886 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,886 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f2/6a9d7c4cbfb34116b642c10e41dab3d0 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0 2023-02-16 14:01:17,887 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 181ea4cd2422c7d97e61580629b5006d in 112ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,887 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,888 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4] hfiles 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba] hfiles 2023-02-16 14:01:17,888 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,891 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f2/ed9d8e7507ca4842b05287e633153017 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017 2023-02-16 14:01:17,905 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,906 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,906 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,906 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 10219cf33b5d182877af26f759faa073 in 130ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,907 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308] hfiles 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,908 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 07dff6e55f0571c845b653956f2fc6a6 in 131ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e] hfiles 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,908 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,909 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0b887a0c3c4a8f324e39e0a9538dfd63 in 135ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,909 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:17,909 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8] hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13] hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0] hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa] hfiles 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,912 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,913 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:17,914 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e68a616bb5f1cc7106cae3ac97003f84 in 138ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,914 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e] hfiles 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41] hfiles 2023-02-16 14:01:17,915 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,918 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:17,919 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 672696ba9762e944cbc5dfa3e0af94ba in 127ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:17,919 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b] hfiles 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017] hfiles 2023-02-16 14:01:17,920 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,923 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. completed. 2023-02-16 14:01:17,923 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:17,923 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:17,923 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:01:17,923 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. started... 2023-02-16 14:01:17,928 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 25ab5f37bedd95ae6d36dd6bf14f9717 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 14:01:17,939 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. completed. 2023-02-16 14:01:17,939 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:17,939 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. completed. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:17,959 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. started... 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. completed. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:17,959 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 14:01:17,959 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. started... 2023-02-16 14:01:17,963 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. completed. 2023-02-16 14:01:17,963 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:17,963 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 14:01:17,974 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. completed. 2023-02-16 14:01:17,974 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:17,974 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:01:17,976 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 32ca3410ed35806b37e5de13b4622ee1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 14:01:17,976 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:17,977 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:17,977 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:17,977 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:17,977 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 14:01:17,985 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f1/51ac2b7041b54acf81dd615a333c4652 2023-02-16 14:01:18,007 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f1/1076c3d7393e4f0d98b45236d6fb4a94 2023-02-16 14:01:18,024 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f2/a17d2277723c41ae9f79500a2be5ddc8 2023-02-16 14:01:18,030 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f1/51ac2b7041b54acf81dd615a333c4652 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652 2023-02-16 14:01:18,035 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:18,036 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f2/a17d2277723c41ae9f79500a2be5ddc8 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8 2023-02-16 14:01:18,041 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 14:01:18,042 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 25ab5f37bedd95ae6d36dd6bf14f9717 in 114ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:18,042 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:18,043 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f2/917278bed8df42c6872d1e945eeb5395 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652] hfiles 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8] hfiles 2023-02-16 14:01:18,043 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,045 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:18,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:18,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:18,047 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 14:01:18,047 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f1/1076c3d7393e4f0d98b45236d6fb4a94 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94 2023-02-16 14:01:18,051 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:18,052 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f2/917278bed8df42c6872d1e945eeb5395 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395 2023-02-16 14:01:18,057 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. completed. 2023-02-16 14:01:18,057 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 14:01:18,057 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:18,057 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:01:18,057 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:01:18,057 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,057 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 14:01:18,057 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,41653,1676556075690' in zk 2023-02-16 14:01:18,058 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 32ca3410ed35806b37e5de13b4622ee1 in 86ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94] hfiles 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395] hfiles 2023-02-16 14:01:18,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,058 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:01:18,058 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:18,058 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,058 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 14:01:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:18,065 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. completed. 2023-02-16 14:01:18,065 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:18,065 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 14:01:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,41653,1676556075690': 2023-02-16 14:01:18,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41653,1676556075690' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 14:01:18,347 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:18,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:18,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:18,349 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 14:01:18,398 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. completed. 2023-02-16 14:01:18,398 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:18,399 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 14:01:18,399 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 14:01:18,399 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,399 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 14:01:18,399 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,46265,1676556075725' in zk 2023-02-16 14:01:18,401 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:01:18,401 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:18,401 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 14:01:18,401 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,46265,1676556075725': 2023-02-16 14:01:18,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46265,1676556075725' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:18,407 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 14:01:18,407 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:18,407 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:18,407 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,407 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:18,410 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,410 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,410 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,410 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,410 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,411 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:18,412 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,414 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:18,415 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:18,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:18,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:18,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:18,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:18,430 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:18,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:18,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:18,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:18,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-16 14:01:18,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,476 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676556077741Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676556078429 (+688 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676556078430 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676556078438 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676556078447 (+9 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676556078476 (+29 ms) 2023-02-16 14:01:18,478 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 14:01:18,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 736 msec 2023-02-16 14:01:18,849 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:18,851 INFO [Listener at localhost.localdomain/36913] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:18,857 INFO [Listener at localhost.localdomain/36913] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:18,865 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:18,886 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:18,886 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:18,932 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:18,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:18,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,940 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 14:01:18,940 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:18,940 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 14:01:18,940 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 14:01:18,941 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,941 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,942 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:18,942 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,942 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:18,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:18,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:18,942 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:18,942 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,942 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:18,942 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:18,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:18,947 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 14:01:18,947 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:18,947 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 14:01:18,947 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:01:18,947 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:18,948 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. started... 2023-02-16 14:01:18,948 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 10219cf33b5d182877af26f759faa073 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. started... 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:18,948 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. started... 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. started... 2023-02-16 14:01:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:01:18,949 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0b887a0c3c4a8f324e39e0a9538dfd63 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. started... 2023-02-16 14:01:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 14:01:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:18,949 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. started... 2023-02-16 14:01:18,950 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. started... 2023-02-16 14:01:18,949 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 181ea4cd2422c7d97e61580629b5006d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:18,949 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e68a616bb5f1cc7106cae3ac97003f84 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:01:18,950 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 672696ba9762e944cbc5dfa3e0af94ba 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:18,950 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 07dff6e55f0571c845b653956f2fc6a6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:18,972 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f1/0f65d166ae0b4a7780db35c3c86fc950 2023-02-16 14:01:18,973 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f1/6c0f86cad7c040c797dc2fa0a42789d7 2023-02-16 14:01:18,973 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f1/32b8199783d642f79a4be92ea77bcb08 2023-02-16 14:01:18,974 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f1/4c988846f96c4131b53ec585b3c2bd65 2023-02-16 14:01:18,977 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1 2023-02-16 14:01:19,020 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f2/a191e0a54b3945ca9aa0258119a94a79 2023-02-16 14:01:19,028 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f1/0f65d166ae0b4a7780db35c3c86fc950 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/0f65d166ae0b4a7780db35c3c86fc950 2023-02-16 14:01:19,037 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/0f65d166ae0b4a7780db35c3c86fc950, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,037 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f2/e10b131b57f540d88494617401e797e9 2023-02-16 14:01:19,037 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f2/538dcae4984a4f5080668d9c750bf2a5 2023-02-16 14:01:19,038 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/.tmp/f2/a191e0a54b3945ca9aa0258119a94a79 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/a191e0a54b3945ca9aa0258119a94a79 2023-02-16 14:01:19,044 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f1/4c988846f96c4131b53ec585b3c2bd65 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4c988846f96c4131b53ec585b3c2bd65 2023-02-16 14:01:19,045 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f1/32b8199783d642f79a4be92ea77bcb08 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/32b8199783d642f79a4be92ea77bcb08 2023-02-16 14:01:19,048 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f2/65536ced0d7a49379d25ac0cdcbc6e65 2023-02-16 14:01:19,050 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f2/20853309fb2145d7b1545577877c15bc 2023-02-16 14:01:19,053 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/a191e0a54b3945ca9aa0258119a94a79, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,054 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0b887a0c3c4a8f324e39e0a9538dfd63 in 105ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,054 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:19,054 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:19,054 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,054 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 14:01:19,055 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. started... 2023-02-16 14:01:19,055 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 32ca3410ed35806b37e5de13b4622ee1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 14:01:19,055 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4c988846f96c4131b53ec585b3c2bd65, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,055 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/32b8199783d642f79a4be92ea77bcb08, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:19,057 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f1/6c0f86cad7c040c797dc2fa0a42789d7 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/6c0f86cad7c040c797dc2fa0a42789d7 2023-02-16 14:01:19,057 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/.tmp/f2/e10b131b57f540d88494617401e797e9 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/e10b131b57f540d88494617401e797e9 2023-02-16 14:01:19,058 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/.tmp/f2/538dcae4984a4f5080668d9c750bf2a5 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/538dcae4984a4f5080668d9c750bf2a5 2023-02-16 14:01:19,059 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1 2023-02-16 14:01:19,062 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/6c0f86cad7c040c797dc2fa0a42789d7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,063 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,063 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/e10b131b57f540d88494617401e797e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/.tmp/f2/65536ced0d7a49379d25ac0cdcbc6e65 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/65536ced0d7a49379d25ac0cdcbc6e65 2023-02-16 14:01:19,064 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 07dff6e55f0571c845b653956f2fc6a6 in 114ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. started... 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:19,064 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,065 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:01:19,065 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:01:19,066 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/.tmp/f2/20853309fb2145d7b1545577877c15bc as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/20853309fb2145d7b1545577877c15bc 2023-02-16 14:01:19,071 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/538dcae4984a4f5080668d9c750bf2a5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:19,072 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/65536ced0d7a49379d25ac0cdcbc6e65, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,073 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e68a616bb5f1cc7106cae3ac97003f84 in 124ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,073 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:19,073 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:19,073 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:01:19,073 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 181ea4cd2422c7d97e61580629b5006d in 124ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,073 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:19,073 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:19,073 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/20853309fb2145d7b1545577877c15bc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,073 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 14:01:19,073 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,074 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. started... 2023-02-16 14:01:19,074 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 25ab5f37bedd95ae6d36dd6bf14f9717 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 14:01:19,074 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f1/66a36dc68892441baf9f2240e1598468 2023-02-16 14:01:19,075 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 10219cf33b5d182877af26f759faa073 in 126ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,075 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:19,076 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:19,076 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 14:01:19,087 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f1/35117f7419494886a3704e330cf08d01 2023-02-16 14:01:19,089 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f2/aaf03c3fac6f47f7bf723004b03ca05b 2023-02-16 14:01:19,095 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f1/66a36dc68892441baf9f2240e1598468 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/66a36dc68892441baf9f2240e1598468 2023-02-16 14:01:19,099 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/66a36dc68892441baf9f2240e1598468, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,100 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/.tmp/f2/aaf03c3fac6f47f7bf723004b03ca05b as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/aaf03c3fac6f47f7bf723004b03ca05b 2023-02-16 14:01:19,104 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/aaf03c3fac6f47f7bf723004b03ca05b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,104 INFO [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 32ca3410ed35806b37e5de13b4622ee1 in 49ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,105 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:19,105 DEBUG [rs(jenkins-hbase20.apache.org,46265,1676556075725)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,105 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:01:19,105 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:01:19,105 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,105 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 14:01:19,105 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46265,1676556075725' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 14:01:19,106 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,106 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:19,106 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,106 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:19,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46265,1676556075725' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 14:01:19,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68b09842[Count = 1] remaining members to acquire global barrier 2023-02-16 14:01:19,115 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f2/ef55262fbb024b5db1ccccbd453b52fc 2023-02-16 14:01:19,120 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f1/35117f7419494886a3704e330cf08d01 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/35117f7419494886a3704e330cf08d01 2023-02-16 14:01:19,123 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/35117f7419494886a3704e330cf08d01, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:19,124 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/.tmp/f2/ef55262fbb024b5db1ccccbd453b52fc as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/ef55262fbb024b5db1ccccbd453b52fc 2023-02-16 14:01:19,128 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/ef55262fbb024b5db1ccccbd453b52fc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 14:01:19,129 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 25ab5f37bedd95ae6d36dd6bf14f9717 in 55ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,129 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:19,129 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,129 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 14:01:19,377 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f1/1b7667fd7fda4f6f8738e1fa0a651941 2023-02-16 14:01:19,406 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f2/66313fcab5734954a987057079dbfe95 2023-02-16 14:01:19,413 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f1/1b7667fd7fda4f6f8738e1fa0a651941 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/1b7667fd7fda4f6f8738e1fa0a651941 2023-02-16 14:01:19,420 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/1b7667fd7fda4f6f8738e1fa0a651941, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,422 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/.tmp/f2/66313fcab5734954a987057079dbfe95 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/66313fcab5734954a987057079dbfe95 2023-02-16 14:01:19,429 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/66313fcab5734954a987057079dbfe95, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 14:01:19,430 INFO [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 672696ba9762e944cbc5dfa3e0af94ba in 480ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:19,430 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:19,430 DEBUG [rs(jenkins-hbase20.apache.org,41653,1676556075690)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:19,430 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 14:01:19,430 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 14:01:19,430 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,430 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 14:01:19,430 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41653,1676556075690' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 14:01:19,431 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,431 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:19,432 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,432 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:19,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:19,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41653,1676556075690' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 14:01:19,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68b09842[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:19,433 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 14:01:19,433 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:19,434 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,46265,1676556075725' in zk 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 14:01:19,434 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,41653,1676556075690' in zk 2023-02-16 14:01:19,434 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,434 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:01:19,435 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:19,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:19,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,41653,1676556075690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 14:01:19,435 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:19,435 DEBUG [member: 'jenkins-hbase20.apache.org,46265,1676556075725' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,41653,1676556075690': 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41653,1676556075690' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:19,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:19,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:19,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:19,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,46265,1676556075725': 2023-02-16 14:01:19,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46265,1676556075725' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:19,439 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 14:01:19,439 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:19,439 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:19,439 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,439 INFO [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:19,440 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:19,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:19,440 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:19,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,440 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,441 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,441 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,442 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:19,442 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:19,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:19,444 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:19,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-16 14:01:19,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:19,445 DEBUG [(jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:19,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:19,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:19,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:19,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:19,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,445 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:19,545 DEBUG [Listener at localhost.localdomain/36913] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:19,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:19,551 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676556077730 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:19,551 DEBUG [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(239): region to add: 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=10219cf33b5d182877af26f759faa073 as 10219cf33b5d182877af26f759faa073 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=0b887a0c3c4a8f324e39e0a9538dfd63 as 0b887a0c3c4a8f324e39e0a9538dfd63 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=07dff6e55f0571c845b653956f2fc6a6 as 07dff6e55f0571c845b653956f2fc6a6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,552 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=e68a616bb5f1cc7106cae3ac97003f84 as e68a616bb5f1cc7106cae3ac97003f84 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=32ca3410ed35806b37e5de13b4622ee1 as 32ca3410ed35806b37e5de13b4622ee1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=2968bc552d8abb227ebb88a44a7f7f07 as 2968bc552d8abb227ebb88a44a7f7f07 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=181ea4cd2422c7d97e61580629b5006d as 181ea4cd2422c7d97e61580629b5006d in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=7ee377f65c38a8311d41824adcb4ff6d as 7ee377f65c38a8311d41824adcb4ff6d in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=672696ba9762e944cbc5dfa3e0af94ba as 672696ba9762e944cbc5dfa3e0af94ba in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,553 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(585): clone region=25ab5f37bedd95ae6d36dd6bf14f9717 as 25ab5f37bedd95ae6d36dd6bf14f9717 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,554 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 32ca3410ed35806b37e5de13b4622ee1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,554 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e68a616bb5f1cc7106cae3ac97003f84, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,554 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 07dff6e55f0571c845b653956f2fc6a6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,554 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0b887a0c3c4a8f324e39e0a9538dfd63, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,554 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 2968bc552d8abb227ebb88a44a7f7f07, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,555 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7ee377f65c38a8311d41824adcb4ff6d, NAME => 'testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,555 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 10219cf33b5d182877af26f759faa073, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,555 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 181ea4cd2422c7d97e61580629b5006d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,587 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,587 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,587 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 205f9ce6804e4722961fca9089a9d6d4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,587 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4eaaf59acc334965967ef3b548a819e8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,587 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,587 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb6cc0d1975045f2b513d58d7e23969e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,605 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9dbc86e83bb14df5b683bfbee5c54e41 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,605 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a9d7c4cbfb34116b642c10e41dab3d0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,605 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 317cc4a504b3492dac11f3873a5850ba from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7ee377f65c38a8311d41824adcb4ff6d, disabling compactions & flushes 2023-02-16 14:01:19,606 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. after waiting 0 ms 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,606 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:19,606 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:19,607 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 672696ba9762e944cbc5dfa3e0af94ba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 181ea4cd2422c7d97e61580629b5006d, disabling compactions & flushes 2023-02-16 14:01:19,609 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1076c3d7393e4f0d98b45236d6fb4a94 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,609 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. after waiting 0 ms 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:19,609 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:19,609 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:19,610 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 25ab5f37bedd95ae6d36dd6bf14f9717, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,615 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,615 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 405b5fd71af54452a5272f50127d2f13 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,618 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,618 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3731e58758fa46f5906c3c2b99915308 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,621 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e68a616bb5f1cc7106cae3ac97003f84, disabling compactions & flushes 2023-02-16 14:01:19,621 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:19,621 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:19,621 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. after waiting 0 ms 2023-02-16 14:01:19,621 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:19,621 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:19,621 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:19,622 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 917278bed8df42c6872d1e945eeb5395 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,622 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 07dff6e55f0571c845b653956f2fc6a6, disabling compactions & flushes 2023-02-16 14:01:19,622 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:19,622 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:19,622 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. after waiting 0 ms 2023-02-16 14:01:19,622 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:19,622 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:19,622 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:19,626 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9f31957bb328473fbe0d0bbc90313a0e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,626 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e4365f0bac24766b4c4f20d60ccccaa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,626 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,626 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 2968bc552d8abb227ebb88a44a7f7f07, disabling compactions & flushes 2023-02-16 14:01:19,627 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:19,627 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:19,627 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. after waiting 0 ms 2023-02-16 14:01:19,627 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:19,627 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:19,627 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:19,631 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0b887a0c3c4a8f324e39e0a9538dfd63, disabling compactions & flushes 2023-02-16 14:01:19,631 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:19,631 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 32ca3410ed35806b37e5de13b4622ee1, disabling compactions & flushes 2023-02-16 14:01:19,631 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 10219cf33b5d182877af26f759faa073, disabling compactions & flushes 2023-02-16 14:01:19,632 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,632 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. after waiting 0 ms 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. after waiting 0 ms 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:19,632 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. after waiting 0 ms 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,632 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:19,632 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:19,632 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:19,633 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,633 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7eb08a9a06545568a00f4fd250fbd7b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,634 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:19,634 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51ac2b7041b54acf81dd615a333c4652 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,635 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ed9d8e7507ca4842b05287e633153017 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,635 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a17d2277723c41ae9f79500a2be5ddc8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:19,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 672696ba9762e944cbc5dfa3e0af94ba, disabling compactions & flushes 2023-02-16 14:01:19,636 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:19,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:19,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. after waiting 0 ms 2023-02-16 14:01:19,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:19,636 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:19,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:19,637 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 25ab5f37bedd95ae6d36dd6bf14f9717, disabling compactions & flushes 2023-02-16 14:01:19,637 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,637 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,637 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. after waiting 0 ms 2023-02-16 14:01:19,637 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,637 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:19,637 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:19,637 INFO [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676556077730 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:19,637 DEBUG [Listener at localhost.localdomain/36913] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,637 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d 2023-02-16 14:01:19,638 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:19,638 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:19,638 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-16 14:01:19,638 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------07dff6e55f0571c845b653956f2fc6a6/ 2023-02-16 14:01:19,639 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,639 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,639 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=07dff6e55f0571c845b653956f2fc6a6-4eaaf59acc334965967ef3b548a819e8 2023-02-16 14:01:19,639 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,639 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=07dff6e55f0571c845b653956f2fc6a6-6a9d7c4cbfb34116b642c10e41dab3d0 2023-02-16 14:01:19,640 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------0b887a0c3c4a8f324e39e0a9538dfd63/ 2023-02-16 14:01:19,640 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,640 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,640 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0b887a0c3c4a8f324e39e0a9538dfd63-405b5fd71af54452a5272f50127d2f13 2023-02-16 14:01:19,640 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,641 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0b887a0c3c4a8f324e39e0a9538dfd63-6e4365f0bac24766b4c4f20d60ccccaa 2023-02-16 14:01:19,641 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------10219cf33b5d182877af26f759faa073/ 2023-02-16 14:01:19,641 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,641 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=10219cf33b5d182877af26f759faa073-3731e58758fa46f5906c3c2b99915308 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=10219cf33b5d182877af26f759faa073-9f31957bb328473fbe0d0bbc90313a0e 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------181ea4cd2422c7d97e61580629b5006d/ 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,642 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,643 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=181ea4cd2422c7d97e61580629b5006d-205f9ce6804e4722961fca9089a9d6d4 2023-02-16 14:01:19,643 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,643 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=181ea4cd2422c7d97e61580629b5006d-317cc4a504b3492dac11f3873a5850ba 2023-02-16 14:01:19,643 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------25ab5f37bedd95ae6d36dd6bf14f9717/ 2023-02-16 14:01:19,644 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,644 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,644 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=25ab5f37bedd95ae6d36dd6bf14f9717-51ac2b7041b54acf81dd615a333c4652 2023-02-16 14:01:19,644 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,644 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=25ab5f37bedd95ae6d36dd6bf14f9717-a17d2277723c41ae9f79500a2be5ddc8 2023-02-16 14:01:19,645 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------2968bc552d8abb227ebb88a44a7f7f07/ 2023-02-16 14:01:19,645 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,645 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------32ca3410ed35806b37e5de13b4622ee1/ 2023-02-16 14:01:19,696 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,696 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,698 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=32ca3410ed35806b37e5de13b4622ee1-1076c3d7393e4f0d98b45236d6fb4a94 2023-02-16 14:01:19,698 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,698 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=32ca3410ed35806b37e5de13b4622ee1-917278bed8df42c6872d1e945eeb5395 2023-02-16 14:01:19,699 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------672696ba9762e944cbc5dfa3e0af94ba/ 2023-02-16 14:01:19,699 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,699 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,699 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=672696ba9762e944cbc5dfa3e0af94ba-a7eb08a9a06545568a00f4fd250fbd7b 2023-02-16 14:01:19,699 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=672696ba9762e944cbc5dfa3e0af94ba-ed9d8e7507ca4842b05287e633153017 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------7ee377f65c38a8311d41824adcb4ff6d/ 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |----------e68a616bb5f1cc7106cae3ac97003f84/ 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:19,700 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:19,701 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e68a616bb5f1cc7106cae3ac97003f84-cb6cc0d1975045f2b513d58d7e23969e 2023-02-16 14:01:19,701 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:19,701 DEBUG [Listener at localhost.localdomain/36913] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e68a616bb5f1cc7106cae3ac97003f84-9dbc86e83bb14df5b683bfbee5c54e41 2023-02-16 14:01:19,704 INFO [Listener at localhost.localdomain/36913] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 14:01:20,230 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,230 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,231 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,233 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,234 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1 2023-02-16 14:01:20,234 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ab5f37bedd95ae6d36dd6bf14f9717 columnFamilyName f1 2023-02-16 14:01:20,238 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/testWithMockedMapReduceMultiRegion=25ab5f37bedd95ae6d36dd6bf14f9717-51ac2b7041b54acf81dd615a333c4652 2023-02-16 14:01:20,238 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(310): Store=25ab5f37bedd95ae6d36dd6bf14f9717/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,239 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,239 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2 2023-02-16 14:01:20,240 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ab5f37bedd95ae6d36dd6bf14f9717 columnFamilyName f2 2023-02-16 14:01:20,244 DEBUG [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/testWithMockedMapReduceMultiRegion=25ab5f37bedd95ae6d36dd6bf14f9717-a17d2277723c41ae9f79500a2be5ddc8 2023-02-16 14:01:20,244 INFO [StoreOpener-25ab5f37bedd95ae6d36dd6bf14f9717-1] regionserver.HStore(310): Store=25ab5f37bedd95ae6d36dd6bf14f9717/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,244 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,244 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 25ab5f37bedd95ae6d36dd6bf14f9717; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69228251, jitterRate=0.0315813273191452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,244 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:20,254 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 25ab5f37bedd95ae6d36dd6bf14f9717, disabling compactions & flushes 2023-02-16 14:01:20,254 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,254 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,255 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. after waiting 0 ms 2023-02-16 14:01:20,255 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,259 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,259 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:20,260 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,260 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,261 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,263 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,264 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1 2023-02-16 14:01:20,264 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dff6e55f0571c845b653956f2fc6a6 columnFamilyName f1 2023-02-16 14:01:20,269 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/testWithMockedMapReduceMultiRegion=07dff6e55f0571c845b653956f2fc6a6-4eaaf59acc334965967ef3b548a819e8 2023-02-16 14:01:20,269 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(310): Store=07dff6e55f0571c845b653956f2fc6a6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,269 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,270 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2 2023-02-16 14:01:20,270 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dff6e55f0571c845b653956f2fc6a6 columnFamilyName f2 2023-02-16 14:01:20,276 DEBUG [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/testWithMockedMapReduceMultiRegion=07dff6e55f0571c845b653956f2fc6a6-6a9d7c4cbfb34116b642c10e41dab3d0 2023-02-16 14:01:20,276 INFO [StoreOpener-07dff6e55f0571c845b653956f2fc6a6-1] regionserver.HStore(310): Store=07dff6e55f0571c845b653956f2fc6a6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,276 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,276 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 07dff6e55f0571c845b653956f2fc6a6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62470137, jitterRate=-0.06912241876125336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,277 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:20,285 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 07dff6e55f0571c845b653956f2fc6a6, disabling compactions & flushes 2023-02-16 14:01:20,285 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,285 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,285 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. after waiting 0 ms 2023-02-16 14:01:20,285 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,287 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,287 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:20,287 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,287 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,289 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,291 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,292 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1 2023-02-16 14:01:20,292 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672696ba9762e944cbc5dfa3e0af94ba columnFamilyName f1 2023-02-16 14:01:20,296 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/testWithMockedMapReduceMultiRegion=672696ba9762e944cbc5dfa3e0af94ba-a7eb08a9a06545568a00f4fd250fbd7b 2023-02-16 14:01:20,297 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(310): Store=672696ba9762e944cbc5dfa3e0af94ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,297 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,297 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2 2023-02-16 14:01:20,298 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672696ba9762e944cbc5dfa3e0af94ba columnFamilyName f2 2023-02-16 14:01:20,302 DEBUG [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/testWithMockedMapReduceMultiRegion=672696ba9762e944cbc5dfa3e0af94ba-ed9d8e7507ca4842b05287e633153017 2023-02-16 14:01:20,302 INFO [StoreOpener-672696ba9762e944cbc5dfa3e0af94ba-1] regionserver.HStore(310): Store=672696ba9762e944cbc5dfa3e0af94ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,302 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,302 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 672696ba9762e944cbc5dfa3e0af94ba; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74001373, jitterRate=0.10270638763904572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,302 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:20,310 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 672696ba9762e944cbc5dfa3e0af94ba, disabling compactions & flushes 2023-02-16 14:01:20,311 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,311 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,311 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. after waiting 0 ms 2023-02-16 14:01:20,311 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,312 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,312 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:20,313 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,313 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,314 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,316 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,317 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1 2023-02-16 14:01:20,317 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b887a0c3c4a8f324e39e0a9538dfd63 columnFamilyName f1 2023-02-16 14:01:20,322 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/testWithMockedMapReduceMultiRegion=0b887a0c3c4a8f324e39e0a9538dfd63-405b5fd71af54452a5272f50127d2f13 2023-02-16 14:01:20,322 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(310): Store=0b887a0c3c4a8f324e39e0a9538dfd63/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,322 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,323 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2 2023-02-16 14:01:20,323 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b887a0c3c4a8f324e39e0a9538dfd63 columnFamilyName f2 2023-02-16 14:01:20,328 DEBUG [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/testWithMockedMapReduceMultiRegion=0b887a0c3c4a8f324e39e0a9538dfd63-6e4365f0bac24766b4c4f20d60ccccaa 2023-02-16 14:01:20,328 INFO [StoreOpener-0b887a0c3c4a8f324e39e0a9538dfd63-1] regionserver.HStore(310): Store=0b887a0c3c4a8f324e39e0a9538dfd63/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,328 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,328 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 0b887a0c3c4a8f324e39e0a9538dfd63; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60196853, jitterRate=-0.10299699008464813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,329 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:20,337 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 0b887a0c3c4a8f324e39e0a9538dfd63, disabling compactions & flushes 2023-02-16 14:01:20,338 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,338 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,339 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. after waiting 0 ms 2023-02-16 14:01:20,339 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,340 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,341 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:20,341 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,341 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,344 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,346 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,346 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1 2023-02-16 14:01:20,347 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181ea4cd2422c7d97e61580629b5006d columnFamilyName f1 2023-02-16 14:01:20,351 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/testWithMockedMapReduceMultiRegion=181ea4cd2422c7d97e61580629b5006d-205f9ce6804e4722961fca9089a9d6d4 2023-02-16 14:01:20,351 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(310): Store=181ea4cd2422c7d97e61580629b5006d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,352 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,352 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2 2023-02-16 14:01:20,353 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181ea4cd2422c7d97e61580629b5006d columnFamilyName f2 2023-02-16 14:01:20,358 DEBUG [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/testWithMockedMapReduceMultiRegion=181ea4cd2422c7d97e61580629b5006d-317cc4a504b3492dac11f3873a5850ba 2023-02-16 14:01:20,358 INFO [StoreOpener-181ea4cd2422c7d97e61580629b5006d-1] regionserver.HStore(310): Store=181ea4cd2422c7d97e61580629b5006d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,358 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,358 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 181ea4cd2422c7d97e61580629b5006d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72493958, jitterRate=0.08024415373802185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,358 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:20,371 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 181ea4cd2422c7d97e61580629b5006d, disabling compactions & flushes 2023-02-16 14:01:20,371 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,371 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,372 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. after waiting 0 ms 2023-02-16 14:01:20,372 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,374 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,374 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:20,375 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,375 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,376 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,378 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,379 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f1 2023-02-16 14:01:20,379 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ee377f65c38a8311d41824adcb4ff6d columnFamilyName f1 2023-02-16 14:01:20,380 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(310): Store=7ee377f65c38a8311d41824adcb4ff6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,380 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,381 DEBUG [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f2 2023-02-16 14:01:20,381 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ee377f65c38a8311d41824adcb4ff6d columnFamilyName f2 2023-02-16 14:01:20,382 INFO [StoreOpener-7ee377f65c38a8311d41824adcb4ff6d-1] regionserver.HStore(310): Store=7ee377f65c38a8311d41824adcb4ff6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,382 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 7ee377f65c38a8311d41824adcb4ff6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58918103, jitterRate=-0.12205184996128082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 7ee377f65c38a8311d41824adcb4ff6d, disabling compactions & flushes 2023-02-16 14:01:20,382 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. after waiting 0 ms 2023-02-16 14:01:20,382 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,383 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,383 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:20,383 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,383 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,386 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,389 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,390 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1 2023-02-16 14:01:20,391 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32ca3410ed35806b37e5de13b4622ee1 columnFamilyName f1 2023-02-16 14:01:20,396 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/testWithMockedMapReduceMultiRegion=32ca3410ed35806b37e5de13b4622ee1-1076c3d7393e4f0d98b45236d6fb4a94 2023-02-16 14:01:20,396 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(310): Store=32ca3410ed35806b37e5de13b4622ee1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,396 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,397 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2 2023-02-16 14:01:20,397 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32ca3410ed35806b37e5de13b4622ee1 columnFamilyName f2 2023-02-16 14:01:20,406 DEBUG [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/testWithMockedMapReduceMultiRegion=32ca3410ed35806b37e5de13b4622ee1-917278bed8df42c6872d1e945eeb5395 2023-02-16 14:01:20,406 INFO [StoreOpener-32ca3410ed35806b37e5de13b4622ee1-1] regionserver.HStore(310): Store=32ca3410ed35806b37e5de13b4622ee1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,406 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,407 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 32ca3410ed35806b37e5de13b4622ee1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61844995, jitterRate=-0.07843776047229767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,407 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:20,416 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 32ca3410ed35806b37e5de13b4622ee1, disabling compactions & flushes 2023-02-16 14:01:20,416 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,416 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,416 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. after waiting 0 ms 2023-02-16 14:01:20,417 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,417 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,417 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:20,418 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,418 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,420 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,424 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,425 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1 2023-02-16 14:01:20,425 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10219cf33b5d182877af26f759faa073 columnFamilyName f1 2023-02-16 14:01:20,430 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/testWithMockedMapReduceMultiRegion=10219cf33b5d182877af26f759faa073-3731e58758fa46f5906c3c2b99915308 2023-02-16 14:01:20,430 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(310): Store=10219cf33b5d182877af26f759faa073/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,430 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,431 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2 2023-02-16 14:01:20,431 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10219cf33b5d182877af26f759faa073 columnFamilyName f2 2023-02-16 14:01:20,435 DEBUG [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/testWithMockedMapReduceMultiRegion=10219cf33b5d182877af26f759faa073-9f31957bb328473fbe0d0bbc90313a0e 2023-02-16 14:01:20,435 INFO [StoreOpener-10219cf33b5d182877af26f759faa073-1] regionserver.HStore(310): Store=10219cf33b5d182877af26f759faa073/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,435 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,436 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 10219cf33b5d182877af26f759faa073; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59852098, jitterRate=-0.10813423991203308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,436 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:20,445 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 10219cf33b5d182877af26f759faa073, disabling compactions & flushes 2023-02-16 14:01:20,445 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,445 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,445 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. after waiting 0 ms 2023-02-16 14:01:20,445 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,446 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,446 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:20,447 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,447 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,448 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,450 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,452 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f1 2023-02-16 14:01:20,452 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2968bc552d8abb227ebb88a44a7f7f07 columnFamilyName f1 2023-02-16 14:01:20,452 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(310): Store=2968bc552d8abb227ebb88a44a7f7f07/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,452 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,453 DEBUG [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f2 2023-02-16 14:01:20,454 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2968bc552d8abb227ebb88a44a7f7f07 columnFamilyName f2 2023-02-16 14:01:20,454 INFO [StoreOpener-2968bc552d8abb227ebb88a44a7f7f07-1] regionserver.HStore(310): Store=2968bc552d8abb227ebb88a44a7f7f07/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,454 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,454 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened 2968bc552d8abb227ebb88a44a7f7f07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62951342, jitterRate=-0.061951905488967896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,454 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:20,455 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing 2968bc552d8abb227ebb88a44a7f7f07, disabling compactions & flushes 2023-02-16 14:01:20,455 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,455 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,455 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. after waiting 0 ms 2023-02-16 14:01:20,455 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,459 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,459 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:20,460 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:20,460 INFO [Listener at localhost.localdomain/36913] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:20,462 DEBUG [Listener at localhost.localdomain/36913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:20,464 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,465 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1 2023-02-16 14:01:20,465 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e68a616bb5f1cc7106cae3ac97003f84 columnFamilyName f1 2023-02-16 14:01:20,470 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/testWithMockedMapReduceMultiRegion=e68a616bb5f1cc7106cae3ac97003f84-cb6cc0d1975045f2b513d58d7e23969e 2023-02-16 14:01:20,470 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(310): Store=e68a616bb5f1cc7106cae3ac97003f84/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,470 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,471 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2 2023-02-16 14:01:20,472 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e68a616bb5f1cc7106cae3ac97003f84 columnFamilyName f2 2023-02-16 14:01:20,478 DEBUG [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40625/user/jenkins/test-data/e8cf9b12-bd94-f335-f0f5-dd80a6e7304f/testWithMockedMapReduceMultiRegion/187f1508-cdfa-422c-be5f-122716c0038d/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/testWithMockedMapReduceMultiRegion=e68a616bb5f1cc7106cae3ac97003f84-9dbc86e83bb14df5b683bfbee5c54e41 2023-02-16 14:01:20,479 INFO [StoreOpener-e68a616bb5f1cc7106cae3ac97003f84-1] regionserver.HStore(310): Store=e68a616bb5f1cc7106cae3ac97003f84/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:20,479 DEBUG [Listener at localhost.localdomain/36913] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:20,479 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1071): Opened e68a616bb5f1cc7106cae3ac97003f84; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61101739, jitterRate=-0.0895131379365921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:20,479 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(964): Region open journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:20,489 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1603): Closing e68a616bb5f1cc7106cae3ac97003f84, disabling compactions & flushes 2023-02-16 14:01:20,489 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,489 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,490 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. after waiting 0 ms 2023-02-16 14:01:20,490 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,490 INFO [Listener at localhost.localdomain/36913] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,490 DEBUG [Listener at localhost.localdomain/36913] regionserver.HRegion(1557): Region close journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:20,495 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-16 14:01:20,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,499 INFO [Listener at localhost.localdomain/36913] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,499 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,503 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556080503"}]},"ts":"1676556080503"} 2023-02-16 14:01:20,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:01:20,505 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-16 14:01:20,506 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-16 14:01:20,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, UNASSIGN}] 2023-02-16 14:01:20,509 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, UNASSIGN 2023-02-16 14:01:20,509 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, UNASSIGN 2023-02-16 14:01:20,509 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, UNASSIGN 2023-02-16 14:01:20,509 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, UNASSIGN 2023-02-16 14:01:20,510 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, UNASSIGN 2023-02-16 14:01:20,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7ee377f65c38a8311d41824adcb4ff6d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,510 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2968bc552d8abb227ebb88a44a7f7f07, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556080510"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080510"}]},"ts":"1676556080510"} 2023-02-16 14:01:20,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=32ca3410ed35806b37e5de13b4622ee1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,510 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556080510"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080510"}]},"ts":"1676556080510"} 2023-02-16 14:01:20,510 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080510"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080510"}]},"ts":"1676556080510"} 2023-02-16 14:01:20,511 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=25ab5f37bedd95ae6d36dd6bf14f9717, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e68a616bb5f1cc7106cae3ac97003f84, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,511 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080511"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080511"}]},"ts":"1676556080511"} 2023-02-16 14:01:20,511 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080511"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080511"}]},"ts":"1676556080511"} 2023-02-16 14:01:20,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 7ee377f65c38a8311d41824adcb4ff6d, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:20,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 2968bc552d8abb227ebb88a44a7f7f07, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:20,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure 32ca3410ed35806b37e5de13b4622ee1, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:20,515 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, UNASSIGN 2023-02-16 14:01:20,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 25ab5f37bedd95ae6d36dd6bf14f9717, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:20,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure e68a616bb5f1cc7106cae3ac97003f84, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:20,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=181ea4cd2422c7d97e61580629b5006d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080516"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080516"}]},"ts":"1676556080516"} 2023-02-16 14:01:20,518 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, UNASSIGN 2023-02-16 14:01:20,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure 181ea4cd2422c7d97e61580629b5006d, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:20,519 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0b887a0c3c4a8f324e39e0a9538dfd63, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,519 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080519"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080519"}]},"ts":"1676556080519"} 2023-02-16 14:01:20,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, UNASSIGN 2023-02-16 14:01:20,521 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, UNASSIGN 2023-02-16 14:01:20,521 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, UNASSIGN 2023-02-16 14:01:20,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure 0b887a0c3c4a8f324e39e0a9538dfd63, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:20,522 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=672696ba9762e944cbc5dfa3e0af94ba, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,522 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=10219cf33b5d182877af26f759faa073, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,523 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080522"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080522"}]},"ts":"1676556080522"} 2023-02-16 14:01:20,522 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=07dff6e55f0571c845b653956f2fc6a6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,523 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080522"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080522"}]},"ts":"1676556080522"} 2023-02-16 14:01:20,523 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080522"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556080522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556080522"}]},"ts":"1676556080522"} 2023-02-16 14:01:20,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=38, state=RUNNABLE; CloseRegionProcedure 672696ba9762e944cbc5dfa3e0af94ba, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:20,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure 10219cf33b5d182877af26f759faa073, server=jenkins-hbase20.apache.org,41653,1676556075690}] 2023-02-16 14:01:20,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=39, state=RUNNABLE; CloseRegionProcedure 07dff6e55f0571c845b653956f2fc6a6, server=jenkins-hbase20.apache.org,46265,1676556075725}] 2023-02-16 14:01:20,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:01:20,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7ee377f65c38a8311d41824adcb4ff6d, disabling compactions & flushes 2023-02-16 14:01:20,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. after waiting 0 ms 2023-02-16 14:01:20,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 672696ba9762e944cbc5dfa3e0af94ba, disabling compactions & flushes 2023-02-16 14:01:20,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. after waiting 0 ms 2023-02-16 14:01:20,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:01:20,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d. 2023-02-16 14:01:20,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7ee377f65c38a8311d41824adcb4ff6d: 2023-02-16 14:01:20,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e68a616bb5f1cc7106cae3ac97003f84, disabling compactions & flushes 2023-02-16 14:01:20,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. after waiting 0 ms 2023-02-16 14:01:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7ee377f65c38a8311d41824adcb4ff6d, regionState=CLOSED 2023-02-16 14:01:20,672 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556080671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080671"}]},"ts":"1676556080671"} 2023-02-16 14:01:20,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba. 2023-02-16 14:01:20,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 672696ba9762e944cbc5dfa3e0af94ba: 2023-02-16 14:01:20,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-16 14:01:20,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 7ee377f65c38a8311d41824adcb4ff6d, server=jenkins-hbase20.apache.org,46265,1676556075725 in 161 msec 2023-02-16 14:01:20,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 10219cf33b5d182877af26f759faa073, disabling compactions & flushes 2023-02-16 14:01:20,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=672696ba9762e944cbc5dfa3e0af94ba, regionState=CLOSED 2023-02-16 14:01:20,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. after waiting 0 ms 2023-02-16 14:01:20,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080676"}]},"ts":"1676556080676"} 2023-02-16 14:01:20,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ee377f65c38a8311d41824adcb4ff6d, UNASSIGN in 169 msec 2023-02-16 14:01:20,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84. 2023-02-16 14:01:20,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e68a616bb5f1cc7106cae3ac97003f84: 2023-02-16 14:01:20,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0b887a0c3c4a8f324e39e0a9538dfd63, disabling compactions & flushes 2023-02-16 14:01:20,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. after waiting 0 ms 2023-02-16 14:01:20,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,681 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e68a616bb5f1cc7106cae3ac97003f84, regionState=CLOSED 2023-02-16 14:01:20,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080680"}]},"ts":"1676556080680"} 2023-02-16 14:01:20,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=38 2023-02-16 14:01:20,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=38, state=SUCCESS; CloseRegionProcedure 672696ba9762e944cbc5dfa3e0af94ba, server=jenkins-hbase20.apache.org,41653,1676556075690 in 153 msec 2023-02-16 14:01:20,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073. 2023-02-16 14:01:20,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 10219cf33b5d182877af26f759faa073: 2023-02-16 14:01:20,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=672696ba9762e944cbc5dfa3e0af94ba, UNASSIGN in 174 msec 2023-02-16 14:01:20,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-16 14:01:20,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure e68a616bb5f1cc7106cae3ac97003f84, server=jenkins-hbase20.apache.org,46265,1676556075725 in 166 msec 2023-02-16 14:01:20,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 2968bc552d8abb227ebb88a44a7f7f07, disabling compactions & flushes 2023-02-16 14:01:20,685 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=10219cf33b5d182877af26f759faa073, regionState=CLOSED 2023-02-16 14:01:20,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. after waiting 0 ms 2023-02-16 14:01:20,686 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080685"}]},"ts":"1676556080685"} 2023-02-16 14:01:20,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e68a616bb5f1cc7106cae3ac97003f84, UNASSIGN in 178 msec 2023-02-16 14:01:20,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63. 2023-02-16 14:01:20,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0b887a0c3c4a8f324e39e0a9538dfd63: 2023-02-16 14:01:20,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-16 14:01:20,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure 10219cf33b5d182877af26f759faa073, server=jenkins-hbase20.apache.org,41653,1676556075690 in 161 msec 2023-02-16 14:01:20,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 14:01:20,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 32ca3410ed35806b37e5de13b4622ee1, disabling compactions & flushes 2023-02-16 14:01:20,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0b887a0c3c4a8f324e39e0a9538dfd63, regionState=CLOSED 2023-02-16 14:01:20,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. after waiting 0 ms 2023-02-16 14:01:20,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07. 2023-02-16 14:01:20,690 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080689"}]},"ts":"1676556080689"} 2023-02-16 14:01:20,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 2968bc552d8abb227ebb88a44a7f7f07: 2023-02-16 14:01:20,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10219cf33b5d182877af26f759faa073, UNASSIGN in 182 msec 2023-02-16 14:01:20,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 181ea4cd2422c7d97e61580629b5006d, disabling compactions & flushes 2023-02-16 14:01:20,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2968bc552d8abb227ebb88a44a7f7f07, regionState=CLOSED 2023-02-16 14:01:20,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676556080692"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080692"}]},"ts":"1676556080692"} 2023-02-16 14:01:20,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. after waiting 0 ms 2023-02-16 14:01:20,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-16 14:01:20,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure 0b887a0c3c4a8f324e39e0a9538dfd63, server=jenkins-hbase20.apache.org,46265,1676556075725 in 170 msec 2023-02-16 14:01:20,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b887a0c3c4a8f324e39e0a9538dfd63, UNASSIGN in 186 msec 2023-02-16 14:01:20,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1. 2023-02-16 14:01:20,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 32ca3410ed35806b37e5de13b4622ee1: 2023-02-16 14:01:20,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-16 14:01:20,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 2968bc552d8abb227ebb88a44a7f7f07, server=jenkins-hbase20.apache.org,41653,1676556075690 in 180 msec 2023-02-16 14:01:20,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 07dff6e55f0571c845b653956f2fc6a6, disabling compactions & flushes 2023-02-16 14:01:20,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. after waiting 0 ms 2023-02-16 14:01:20,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,697 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=32ca3410ed35806b37e5de13b4622ee1, regionState=CLOSED 2023-02-16 14:01:20,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2968bc552d8abb227ebb88a44a7f7f07, UNASSIGN in 190 msec 2023-02-16 14:01:20,698 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080697"}]},"ts":"1676556080697"} 2023-02-16 14:01:20,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d. 2023-02-16 14:01:20,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 181ea4cd2422c7d97e61580629b5006d: 2023-02-16 14:01:20,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 25ab5f37bedd95ae6d36dd6bf14f9717, disabling compactions & flushes 2023-02-16 14:01:20,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. after waiting 0 ms 2023-02-16 14:01:20,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-16 14:01:20,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=181ea4cd2422c7d97e61580629b5006d, regionState=CLOSED 2023-02-16 14:01:20,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure 32ca3410ed35806b37e5de13b4622ee1, server=jenkins-hbase20.apache.org,46265,1676556075725 in 186 msec 2023-02-16 14:01:20,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080701"}]},"ts":"1676556080701"} 2023-02-16 14:01:20,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=32ca3410ed35806b37e5de13b4622ee1, UNASSIGN in 194 msec 2023-02-16 14:01:20,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6. 2023-02-16 14:01:20,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 07dff6e55f0571c845b653956f2fc6a6: 2023-02-16 14:01:20,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-16 14:01:20,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure 181ea4cd2422c7d97e61580629b5006d, server=jenkins-hbase20.apache.org,41653,1676556075690 in 184 msec 2023-02-16 14:01:20,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:20,705 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=07dff6e55f0571c845b653956f2fc6a6, regionState=CLOSED 2023-02-16 14:01:20,706 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080705"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080705"}]},"ts":"1676556080705"} 2023-02-16 14:01:20,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=181ea4cd2422c7d97e61580629b5006d, UNASSIGN in 198 msec 2023-02-16 14:01:20,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717. 2023-02-16 14:01:20,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 25ab5f37bedd95ae6d36dd6bf14f9717: 2023-02-16 14:01:20,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=25ab5f37bedd95ae6d36dd6bf14f9717, regionState=CLOSED 2023-02-16 14:01:20,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676556080708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556080708"}]},"ts":"1676556080708"} 2023-02-16 14:01:20,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=39 2023-02-16 14:01:20,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=39, state=SUCCESS; CloseRegionProcedure 07dff6e55f0571c845b653956f2fc6a6, server=jenkins-hbase20.apache.org,46265,1676556075725 in 176 msec 2023-02-16 14:01:20,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=07dff6e55f0571c845b653956f2fc6a6, UNASSIGN in 201 msec 2023-02-16 14:01:20,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-16 14:01:20,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 25ab5f37bedd95ae6d36dd6bf14f9717, server=jenkins-hbase20.apache.org,41653,1676556075690 in 194 msec 2023-02-16 14:01:20,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-16 14:01:20,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=25ab5f37bedd95ae6d36dd6bf14f9717, UNASSIGN in 203 msec 2023-02-16 14:01:20,711 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556080711"}]},"ts":"1676556080711"} 2023-02-16 14:01:20,712 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-16 14:01:20,713 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-16 14:01:20,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 214 msec 2023-02-16 14:01:20,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 14:01:20,806 INFO [Listener at localhost.localdomain/36913] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-16 14:01:20,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,811 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,811 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,827 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,830 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/recovered.edits] 2023-02-16 14:01:20,831 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/recovered.edits] 2023-02-16 14:01:20,832 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/recovered.edits] 2023-02-16 14:01:20,832 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/recovered.edits] 2023-02-16 14:01:20,833 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/recovered.edits] 2023-02-16 14:01:20,833 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/recovered.edits] 2023-02-16 14:01:20,834 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/recovered.edits] 2023-02-16 14:01:20,834 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/recovered.edits] 2023-02-16 14:01:20,838 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/3731e58758fa46f5906c3c2b99915308 2023-02-16 14:01:20,839 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4c988846f96c4131b53ec585b3c2bd65 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4c988846f96c4131b53ec585b3c2bd65 2023-02-16 14:01:20,839 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/35117f7419494886a3704e330cf08d01 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/35117f7419494886a3704e330cf08d01 2023-02-16 14:01:20,839 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/0f65d166ae0b4a7780db35c3c86fc950 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/0f65d166ae0b4a7780db35c3c86fc950 2023-02-16 14:01:20,839 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/1076c3d7393e4f0d98b45236d6fb4a94 2023-02-16 14:01:20,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/1b7667fd7fda4f6f8738e1fa0a651941 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/1b7667fd7fda4f6f8738e1fa0a651941 2023-02-16 14:01:20,840 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/205f9ce6804e4722961fca9089a9d6d4 2023-02-16 14:01:20,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/6c0f86cad7c040c797dc2fa0a42789d7 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f1/6c0f86cad7c040c797dc2fa0a42789d7 2023-02-16 14:01:20,841 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f1/4eaaf59acc334965967ef3b548a819e8 2023-02-16 14:01:20,841 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f1/405b5fd71af54452a5272f50127d2f13 2023-02-16 14:01:20,841 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f1/51ac2b7041b54acf81dd615a333c4652 2023-02-16 14:01:20,841 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/recovered.edits/6.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d/recovered.edits/6.seqid 2023-02-16 14:01:20,841 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/66a36dc68892441baf9f2240e1598468 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f1/66a36dc68892441baf9f2240e1598468 2023-02-16 14:01:20,842 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f1/a7eb08a9a06545568a00f4fd250fbd7b 2023-02-16 14:01:20,842 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ee377f65c38a8311d41824adcb4ff6d 2023-02-16 14:01:20,842 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,843 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f1/3ffba3cc09d34c7aaaeec23bb0b9b5e1 2023-02-16 14:01:20,845 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/6a9d7c4cbfb34116b642c10e41dab3d0 2023-02-16 14:01:20,845 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/recovered.edits] 2023-02-16 14:01:20,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/20853309fb2145d7b1545577877c15bc to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/20853309fb2145d7b1545577877c15bc 2023-02-16 14:01:20,846 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/6e4365f0bac24766b4c4f20d60ccccaa 2023-02-16 14:01:20,846 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/a17d2277723c41ae9f79500a2be5ddc8 2023-02-16 14:01:20,846 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/66313fcab5734954a987057079dbfe95 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/66313fcab5734954a987057079dbfe95 2023-02-16 14:01:20,847 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/917278bed8df42c6872d1e945eeb5395 2023-02-16 14:01:20,847 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/f2/9f31957bb328473fbe0d0bbc90313a0e 2023-02-16 14:01:20,847 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/e10b131b57f540d88494617401e797e9 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/f2/e10b131b57f540d88494617401e797e9 2023-02-16 14:01:20,848 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/317cc4a504b3492dac11f3873a5850ba 2023-02-16 14:01:20,848 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/a191e0a54b3945ca9aa0258119a94a79 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/f2/a191e0a54b3945ca9aa0258119a94a79 2023-02-16 14:01:20,851 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/ef55262fbb024b5db1ccccbd453b52fc to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/f2/ef55262fbb024b5db1ccccbd453b52fc 2023-02-16 14:01:20,851 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/aaf03c3fac6f47f7bf723004b03ca05b to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/f2/aaf03c3fac6f47f7bf723004b03ca05b 2023-02-16 14:01:20,852 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/f2/ed9d8e7507ca4842b05287e633153017 2023-02-16 14:01:20,853 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/65536ced0d7a49379d25ac0cdcbc6e65 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/f2/65536ced0d7a49379d25ac0cdcbc6e65 2023-02-16 14:01:20,854 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073/recovered.edits/12.seqid 2023-02-16 14:01:20,857 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6/recovered.edits/12.seqid 2023-02-16 14:01:20,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/10219cf33b5d182877af26f759faa073 2023-02-16 14:01:20,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/32b8199783d642f79a4be92ea77bcb08 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/32b8199783d642f79a4be92ea77bcb08 2023-02-16 14:01:20,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,858 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/07dff6e55f0571c845b653956f2fc6a6 2023-02-16 14:01:20,858 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63/recovered.edits/12.seqid 2023-02-16 14:01:20,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717/recovered.edits/12.seqid 2023-02-16 14:01:20,859 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b887a0c3c4a8f324e39e0a9538dfd63 2023-02-16 14:01:20,859 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1/recovered.edits/12.seqid 2023-02-16 14:01:20,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/25ab5f37bedd95ae6d36dd6bf14f9717 2023-02-16 14:01:20,860 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba/recovered.edits/12.seqid 2023-02-16 14:01:20,860 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f1/cb6cc0d1975045f2b513d58d7e23969e 2023-02-16 14:01:20,860 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/32ca3410ed35806b37e5de13b4622ee1 2023-02-16 14:01:20,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d/recovered.edits/12.seqid 2023-02-16 14:01:20,861 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/672696ba9762e944cbc5dfa3e0af94ba 2023-02-16 14:01:20,861 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f1, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/f2, FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/recovered.edits] 2023-02-16 14:01:20,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/181ea4cd2422c7d97e61580629b5006d 2023-02-16 14:01:20,863 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/538dcae4984a4f5080668d9c750bf2a5 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/538dcae4984a4f5080668d9c750bf2a5 2023-02-16 14:01:20,864 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41 to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/f2/9dbc86e83bb14df5b683bfbee5c54e41 2023-02-16 14:01:20,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/recovered.edits/6.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07/recovered.edits/6.seqid 2023-02-16 14:01:20,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/2968bc552d8abb227ebb88a44a7f7f07 2023-02-16 14:01:20,866 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/recovered.edits/12.seqid to hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/archive/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84/recovered.edits/12.seqid 2023-02-16 14:01:20,866 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/.tmp/data/default/testWithMockedMapReduceMultiRegion/e68a616bb5f1cc7106cae3ac97003f84 2023-02-16 14:01:20,866 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 14:01:20,868 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,870 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-16 14:01:20,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676556077010.10219cf33b5d182877af26f759faa073.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556080873"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,875 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 14:01:20,875 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ee377f65c38a8311d41824adcb4ff6d, NAME => 'testWithMockedMapReduceMultiRegion,,1676556077010.7ee377f65c38a8311d41824adcb4ff6d.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 25ab5f37bedd95ae6d36dd6bf14f9717, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676556077010.25ab5f37bedd95ae6d36dd6bf14f9717.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 32ca3410ed35806b37e5de13b4622ee1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676556077010.32ca3410ed35806b37e5de13b4622ee1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 10219cf33b5d182877af26f759faa073, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676556077010.10219cf33b5d182877af26f759faa073.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 672696ba9762e944cbc5dfa3e0af94ba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676556077010.672696ba9762e944cbc5dfa3e0af94ba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 07dff6e55f0571c845b653956f2fc6a6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676556077010.07dff6e55f0571c845b653956f2fc6a6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 0b887a0c3c4a8f324e39e0a9538dfd63, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676556077010.0b887a0c3c4a8f324e39e0a9538dfd63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 181ea4cd2422c7d97e61580629b5006d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676556077010.181ea4cd2422c7d97e61580629b5006d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => e68a616bb5f1cc7106cae3ac97003f84, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676556077010.e68a616bb5f1cc7106cae3ac97003f84.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 2968bc552d8abb227ebb88a44a7f7f07, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676556077010.2968bc552d8abb227ebb88a44a7f7f07.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 14:01:20,875 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-16 14:01:20,875 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556080875"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:20,877 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-16 14:01:20,878 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 14:01:20,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 70 msec 2023-02-16 14:01:20,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 14:01:20,914 INFO [Listener at localhost.localdomain/36913] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-16 14:01:20,915 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:20,915 INFO [Listener at localhost.localdomain/36913] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:20,915 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0af03bf1 to 127.0.0.1:50483 2023-02-16 14:01:20,915 DEBUG [Listener at localhost.localdomain/36913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:20,915 DEBUG [Listener at localhost.localdomain/36913] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:20,915 DEBUG [Listener at localhost.localdomain/36913] util.JVMClusterUtil(257): Found active master hash=1923535879, stopped=false 2023-02-16 14:01:20,916 INFO [Listener at localhost.localdomain/36913] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:20,916 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:20,917 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:20,917 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:20,917 INFO [Listener at localhost.localdomain/36913] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:20,916 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:20,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:20,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:20,920 DEBUG [Listener at localhost.localdomain/36913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2af5f614 to 127.0.0.1:50483 2023-02-16 14:01:20,921 DEBUG [Listener at localhost.localdomain/36913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:20,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:20,921 INFO [Listener at localhost.localdomain/36913] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41653,1676556075690' ***** 2023-02-16 14:01:20,921 INFO [Listener at localhost.localdomain/36913] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:20,921 INFO [Listener at localhost.localdomain/36913] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46265,1676556075725' ***** 2023-02-16 14:01:20,921 INFO [Listener at localhost.localdomain/36913] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:20,921 INFO [RS:0;jenkins-hbase20:41653] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:20,922 INFO [RS:1;jenkins-hbase20:46265] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:20,922 INFO [RS:0;jenkins-hbase20:41653] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:20,922 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:20,922 INFO [RS:0;jenkins-hbase20:41653] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:20,922 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:20,922 INFO [RS:1;jenkins-hbase20:46265] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:20,923 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:20,924 INFO [RS:1;jenkins-hbase20:46265] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:20,924 DEBUG [RS:0;jenkins-hbase20:41653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a216ba4 to 127.0.0.1:50483 2023-02-16 14:01:20,924 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(3304): Received CLOSE for 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:20,924 DEBUG [RS:0;jenkins-hbase20:41653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:20,924 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41653,1676556075690; all regions closed. 2023-02-16 14:01:20,924 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:20,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 98908a39744cead65d12521d9c157a21, disabling compactions & flushes 2023-02-16 14:01:20,925 DEBUG [RS:1;jenkins-hbase20:46265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0abcb96c to 127.0.0.1:50483 2023-02-16 14:01:20,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:20,925 DEBUG [RS:1;jenkins-hbase20:46265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:20,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:20,926 INFO [RS:1;jenkins-hbase20:46265] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:20,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. after waiting 0 ms 2023-02-16 14:01:20,926 INFO [RS:1;jenkins-hbase20:46265] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:20,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:20,926 INFO [RS:1;jenkins-hbase20:46265] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:20,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 98908a39744cead65d12521d9c157a21 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:20,926 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:20,928 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 14:01:20,928 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1479): Online Regions={98908a39744cead65d12521d9c157a21=hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 14:01:20,928 DEBUG [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1505): Waiting on 1588230740, 98908a39744cead65d12521d9c157a21 2023-02-16 14:01:20,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:20,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:20,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:20,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:20,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:20,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.39 KB heapSize=44.49 KB 2023-02-16 14:01:20,931 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/WALs/jenkins-hbase20.apache.org,41653,1676556075690/jenkins-hbase20.apache.org%2C41653%2C1676556075690.1676556077103 not finished, retry = 0 2023-02-16 14:01:20,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/.tmp/info/41df41d4ef83481ea047cbd4a84491f5 2023-02-16 14:01:20,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.76 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/info/17d0e03e4f694273992109fee4656e9f 2023-02-16 14:01:20,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/.tmp/info/41df41d4ef83481ea047cbd4a84491f5 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/info/41df41d4ef83481ea047cbd4a84491f5 2023-02-16 14:01:20,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17d0e03e4f694273992109fee4656e9f 2023-02-16 14:01:20,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/info/41df41d4ef83481ea047cbd4a84491f5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:20,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 98908a39744cead65d12521d9c157a21 in 40ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:20,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/rep_barrier/f20bcfb20d854d5b9e9d5311241a4e49 2023-02-16 14:01:20,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/namespace/98908a39744cead65d12521d9c157a21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:20,997 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:20,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:20,997 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:20,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 98908a39744cead65d12521d9c157a21: 2023-02-16 14:01:20,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556076415.98908a39744cead65d12521d9c157a21. 2023-02-16 14:01:21,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f20bcfb20d854d5b9e9d5311241a4e49 2023-02-16 14:01:21,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/table/2793bdd6d59b442581a51c96e665d9c3 2023-02-16 14:01:21,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2793bdd6d59b442581a51c96e665d9c3 2023-02-16 14:01:21,020 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/info/17d0e03e4f694273992109fee4656e9f as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/info/17d0e03e4f694273992109fee4656e9f 2023-02-16 14:01:21,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17d0e03e4f694273992109fee4656e9f 2023-02-16 14:01:21,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/info/17d0e03e4f694273992109fee4656e9f, entries=30, sequenceid=57, filesize=8.3 K 2023-02-16 14:01:21,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/rep_barrier/f20bcfb20d854d5b9e9d5311241a4e49 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/rep_barrier/f20bcfb20d854d5b9e9d5311241a4e49 2023-02-16 14:01:21,034 DEBUG [RS:0;jenkins-hbase20:41653] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41653%2C1676556075690:(num 1676556077103) 2023-02-16 14:01:21,034 DEBUG [RS:0;jenkins-hbase20:41653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:21,034 INFO [RS:0;jenkins-hbase20:41653] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:21,035 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:21,036 INFO [RS:0;jenkins-hbase20:41653] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41653 2023-02-16 14:01:21,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f20bcfb20d854d5b9e9d5311241a4e49 2023-02-16 14:01:21,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/rep_barrier/f20bcfb20d854d5b9e9d5311241a4e49, entries=10, sequenceid=57, filesize=6.1 K 2023-02-16 14:01:21,038 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:21,038 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:21,039 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41653,1676556075690 2023-02-16 14:01:21,039 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ae4245 rejected from java.util.concurrent.ThreadPoolExecutor@491d688[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,039 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:21,039 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@256abc9 rejected from java.util.concurrent.ThreadPoolExecutor@491d688[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,039 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:21,040 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41653,1676556075690] 2023-02-16 14:01:21,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/.tmp/table/2793bdd6d59b442581a51c96e665d9c3 as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/table/2793bdd6d59b442581a51c96e665d9c3 2023-02-16 14:01:21,040 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41653,1676556075690; numProcessing=1 2023-02-16 14:01:21,041 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41653,1676556075690 already deleted, retry=false 2023-02-16 14:01:21,041 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41653,1676556075690 expired; onlineServers=1 2023-02-16 14:01:21,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2793bdd6d59b442581a51c96e665d9c3 2023-02-16 14:01:21,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/table/2793bdd6d59b442581a51c96e665d9c3, entries=13, sequenceid=57, filesize=6.1 K 2023-02-16 14:01:21,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.39 KB/29073, heapSize ~44.45 KB/45512, currentSize=0 B/0 for 1588230740 in 115ms, sequenceid=57, compaction requested=false 2023-02-16 14:01:21,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 14:01:21,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:21,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:21,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:21,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:21,076 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 14:01:21,076 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 14:01:21,130 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46265,1676556075725; all regions closed. 2023-02-16 14:01:21,137 DEBUG [RS:1;jenkins-hbase20:46265] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs 2023-02-16 14:01:21,137 INFO [RS:1;jenkins-hbase20:46265] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46265%2C1676556075725.meta:.meta(num 1676556076342) 2023-02-16 14:01:21,141 DEBUG [RS:1;jenkins-hbase20:46265] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/oldWALs 2023-02-16 14:01:21,141 INFO [RS:1;jenkins-hbase20:46265] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46265%2C1676556075725:(num 1676556076773) 2023-02-16 14:01:21,141 DEBUG [RS:1;jenkins-hbase20:46265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:21,141 INFO [RS:1;jenkins-hbase20:46265] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:21,141 INFO [RS:1;jenkins-hbase20:46265] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:21,141 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:21,142 INFO [RS:1;jenkins-hbase20:46265] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46265 2023-02-16 14:01:21,143 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46265,1676556075725 2023-02-16 14:01:21,143 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:21,144 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43c4f682 rejected from java.util.concurrent.ThreadPoolExecutor@47fb6a22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,144 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46265,1676556075725] 2023-02-16 14:01:21,144 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46265,1676556075725; numProcessing=2 2023-02-16 14:01:21,145 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46265,1676556075725 already deleted, retry=false 2023-02-16 14:01:21,145 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46265,1676556075725 expired; onlineServers=0 2023-02-16 14:01:21,145 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42445,1676556075566' ***** 2023-02-16 14:01:21,145 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:21,146 DEBUG [M:0;jenkins-hbase20:42445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76994e8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:21,146 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42445,1676556075566 2023-02-16 14:01:21,147 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42445,1676556075566; all regions closed. 2023-02-16 14:01:21,147 DEBUG [M:0;jenkins-hbase20:42445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:21,147 DEBUG [M:0;jenkins-hbase20:42445] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:21,147 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:21,147 DEBUG [M:0;jenkins-hbase20:42445] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:21,147 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556075921] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556075921,5,FailOnTimeoutGroup] 2023-02-16 14:01:21,147 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556075922] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556075922,5,FailOnTimeoutGroup] 2023-02-16 14:01:21,147 INFO [M:0;jenkins-hbase20:42445] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:21,147 INFO [M:0;jenkins-hbase20:42445] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:21,147 INFO [M:0;jenkins-hbase20:42445] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:21,147 DEBUG [M:0;jenkins-hbase20:42445] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:21,147 INFO [M:0;jenkins-hbase20:42445] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:21,148 ERROR [M:0;jenkins-hbase20:42445] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:21,148 INFO [M:0;jenkins-hbase20:42445] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:21,148 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:21,149 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:21,149 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:21,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:21,149 DEBUG [M:0;jenkins-hbase20:42445] zookeeper.ZKUtil(398): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:21,149 WARN [M:0;jenkins-hbase20:42445] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:21,149 INFO [M:0;jenkins-hbase20:42445] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:21,151 INFO [M:0;jenkins-hbase20:42445] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:21,152 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:21,152 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:21,152 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:21,152 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:21,152 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:21,152 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.38 KB heapSize=200.34 KB 2023-02-16 14:01:21,420 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,420 INFO [RS:1;jenkins-hbase20:46265] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46265,1676556075725; zookeeper connection closed. 2023-02-16 14:01:21,421 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57a57425 rejected from java.util.concurrent.ThreadPoolExecutor@47fb6a22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,421 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:46265-0x1016b9743b30002, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,421 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18a852de] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18a852de 2023-02-16 14:01:21,421 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f872e8b rejected from java.util.concurrent.ThreadPoolExecutor@47fb6a22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,521 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,521 INFO [RS:0;jenkins-hbase20:41653] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41653,1676556075690; zookeeper connection closed. 2023-02-16 14:01:21,521 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a37d0b1 rejected from java.util.concurrent.ThreadPoolExecutor@491d688[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,521 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76e53c4a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76e53c4a 2023-02-16 14:01:21,521 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): regionserver:41653-0x1016b9743b30001, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,521 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1683582c rejected from java.util.concurrent.ThreadPoolExecutor@491d688[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,521 INFO [Listener at localhost.localdomain/36913] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:21,565 INFO [M:0;jenkins-hbase20:42445] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.38 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/214671c53f63458fa5dbac861b5a24fc 2023-02-16 14:01:21,570 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/214671c53f63458fa5dbac861b5a24fc as hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/214671c53f63458fa5dbac861b5a24fc 2023-02-16 14:01:21,575 INFO [M:0;jenkins-hbase20:42445] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40625/user/jenkins/test-data/c302e2cc-1c0b-5b39-6441-93cafc7345a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/214671c53f63458fa5dbac861b5a24fc, entries=53, sequenceid=357, filesize=10.7 K 2023-02-16 14:01:21,576 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegion(2947): Finished flush of dataSize ~167.38 KB/171396, heapSize ~200.33 KB/205136, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 424ms, sequenceid=357, compaction requested=false 2023-02-16 14:01:21,577 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:21,577 DEBUG [M:0;jenkins-hbase20:42445] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:21,581 INFO [M:0;jenkins-hbase20:42445] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:21,581 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:21,582 INFO [M:0;jenkins-hbase20:42445] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42445 2023-02-16 14:01:21,584 DEBUG [M:0;jenkins-hbase20:42445] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,42445,1676556075566 already deleted, retry=false 2023-02-16 14:01:21,685 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,685 INFO [M:0;jenkins-hbase20:42445] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42445,1676556075566; zookeeper connection closed. 2023-02-16 14:01:21,685 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1652df56 rejected from java.util.concurrent.ThreadPoolExecutor@126d4944[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,687 DEBUG [Listener at localhost.localdomain/36913-EventThread] zookeeper.ZKWatcher(600): master:42445-0x1016b9743b30000, quorum=127.0.0.1:50483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:21,688 ERROR [Listener at localhost.localdomain/36913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@665ac936 rejected from java.util.concurrent.ThreadPoolExecutor@126d4944[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:21,688 WARN [Listener at localhost.localdomain/36913] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:21,697 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:21,807 WARN [BP-782713910-148.251.75.209-1676556075034 heartbeating to localhost.localdomain/127.0.0.1:40625] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:21,807 WARN [BP-782713910-148.251.75.209-1676556075034 heartbeating to localhost.localdomain/127.0.0.1:40625] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782713910-148.251.75.209-1676556075034 (Datanode Uuid 7a3ac34c-e3b5-4415-9c5b-c9ffeb70929e) service to localhost.localdomain/127.0.0.1:40625 2023-02-16 14:01:21,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/dfs/data/data3/current/BP-782713910-148.251.75.209-1676556075034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:21,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/dfs/data/data4/current/BP-782713910-148.251.75.209-1676556075034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:21,809 WARN [Listener at localhost.localdomain/36913] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:21,813 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:21,923 WARN [BP-782713910-148.251.75.209-1676556075034 heartbeating to localhost.localdomain/127.0.0.1:40625] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:21,924 WARN [BP-782713910-148.251.75.209-1676556075034 heartbeating to localhost.localdomain/127.0.0.1:40625] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782713910-148.251.75.209-1676556075034 (Datanode Uuid 4c2b03f4-a309-48d9-912c-ff4337f6b297) service to localhost.localdomain/127.0.0.1:40625 2023-02-16 14:01:21,928 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/dfs/data/data1/current/BP-782713910-148.251.75.209-1676556075034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:21,929 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/cluster_e4acf77a-c9cb-5b34-058a-1cba05006ed2/dfs/data/data2/current/BP-782713910-148.251.75.209-1676556075034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:21,943 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:22,067 INFO [Listener at localhost.localdomain/36913] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:22,116 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:22,129 INFO [Listener at localhost.localdomain/36913] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40625 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40625 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40625 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase20.apache.org,42445,1676556075566)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40625 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost.localdomain:40625 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost.localdomain:40625 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36913.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40625 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=628 (was 572) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 284), ProcessCount=166 (was 166), AvailableMemoryMB=2889 (was 3124) 2023-02-16 14:01:22,140 INFO [Listener at localhost.localdomain/36913] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=166, AvailableMemoryMB=2889 2023-02-16 14:01:22,151 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.log.dir so I do NOT create it in target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b 2023-02-16 14:01:22,151 WARN [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:22,151 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.tmp.dir so I do NOT create it in target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b 2023-02-16 14:01:22,152 WARN [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e953faea-2015-7523-e90d-241af3de124c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:22,152 DEBUG [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc, deleteOnExit=true 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/test.cache.data in system properties and HBase conf 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:22,152 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:22,152 DEBUG [Listener at localhost.localdomain/36913] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:22,153 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:22,154 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:22,154 INFO [Listener at localhost.localdomain/36913] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:22,156 WARN [Listener at localhost.localdomain/36913] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:22,156 WARN [Listener at localhost.localdomain/36913] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:22,181 WARN [Listener at localhost.localdomain/36913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:22,184 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:22,192 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/java.io.tmpdir/Jetty_localhost_localdomain_38941_hdfs____.t6ddmd/webapp 2023-02-16 14:01:22,277 INFO [Listener at localhost.localdomain/36913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38941 2023-02-16 14:01:22,280 WARN [Listener at localhost.localdomain/36913] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:22,280 WARN [Listener at localhost.localdomain/36913] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:22,311 WARN [Listener at localhost.localdomain/36277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:22,332 WARN [Listener at localhost.localdomain/36277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:22,335 WARN [Listener at localhost.localdomain/36277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:22,336 INFO [Listener at localhost.localdomain/36277] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:22,341 INFO [Listener at localhost.localdomain/36277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/java.io.tmpdir/Jetty_localhost_38561_datanode____.758vvy/webapp 2023-02-16 14:01:22,421 INFO [Listener at localhost.localdomain/36277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38561 2023-02-16 14:01:22,432 WARN [Listener at localhost.localdomain/39767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:22,449 WARN [Listener at localhost.localdomain/39767] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:22,555 WARN [Listener at localhost.localdomain/39767] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:22,564 WARN [Listener at localhost.localdomain/39767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:22,567 INFO [Listener at localhost.localdomain/39767] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:22,571 INFO [Listener at localhost.localdomain/39767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/java.io.tmpdir/Jetty_localhost_32879_datanode____3lcci/webapp 2023-02-16 14:01:22,590 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd54aa56fce67556f: Processing first storage report for DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850 from datanode 0d07c789-c7fb-4939-8a5e-7a3a1921374c 2023-02-16 14:01:22,591 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd54aa56fce67556f: from storage DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850 node DatanodeRegistration(127.0.0.1:44965, datanodeUuid=0d07c789-c7fb-4939-8a5e-7a3a1921374c, infoPort=37891, infoSecurePort=0, ipcPort=39767, storageInfo=lv=-57;cid=testClusterID;nsid=727964952;c=1676556082157), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:22,591 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd54aa56fce67556f: Processing first storage report for DS-a471fbc3-819e-47c7-8865-fb19d42db68d from datanode 0d07c789-c7fb-4939-8a5e-7a3a1921374c 2023-02-16 14:01:22,591 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd54aa56fce67556f: from storage DS-a471fbc3-819e-47c7-8865-fb19d42db68d node DatanodeRegistration(127.0.0.1:44965, datanodeUuid=0d07c789-c7fb-4939-8a5e-7a3a1921374c, infoPort=37891, infoSecurePort=0, ipcPort=39767, storageInfo=lv=-57;cid=testClusterID;nsid=727964952;c=1676556082157), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:22,650 INFO [Listener at localhost.localdomain/39767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32879 2023-02-16 14:01:22,659 WARN [Listener at localhost.localdomain/34581] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:22,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1dfdb41e6375a5b6: Processing first storage report for DS-d1a333c3-ae8d-4024-bc97-c342587f5164 from datanode 40c2e592-521b-4633-b1b2-9d1f8b81117b 2023-02-16 14:01:22,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1dfdb41e6375a5b6: from storage DS-d1a333c3-ae8d-4024-bc97-c342587f5164 node DatanodeRegistration(127.0.0.1:39907, datanodeUuid=40c2e592-521b-4633-b1b2-9d1f8b81117b, infoPort=36295, infoSecurePort=0, ipcPort=34581, storageInfo=lv=-57;cid=testClusterID;nsid=727964952;c=1676556082157), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:22,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1dfdb41e6375a5b6: Processing first storage report for DS-57a1e5bc-8673-4335-942b-b7bc4fc137ea from datanode 40c2e592-521b-4633-b1b2-9d1f8b81117b 2023-02-16 14:01:22,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1dfdb41e6375a5b6: from storage DS-57a1e5bc-8673-4335-942b-b7bc4fc137ea node DatanodeRegistration(127.0.0.1:39907, datanodeUuid=40c2e592-521b-4633-b1b2-9d1f8b81117b, infoPort=36295, infoSecurePort=0, ipcPort=34581, storageInfo=lv=-57;cid=testClusterID;nsid=727964952;c=1676556082157), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:22,769 DEBUG [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b 2023-02-16 14:01:22,772 INFO [Listener at localhost.localdomain/34581] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/zookeeper_0, clientPort=58816, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:22,773 INFO [Listener at localhost.localdomain/34581] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58816 2023-02-16 14:01:22,773 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,775 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,792 INFO [Listener at localhost.localdomain/34581] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7 with version=8 2023-02-16 14:01:22,792 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,794 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,795 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/hbase-staging 2023-02-16 14:01:22,797 INFO [Listener at localhost.localdomain/34581] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:22,798 INFO [Listener at localhost.localdomain/34581] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:22,799 INFO [Listener at localhost.localdomain/34581] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43233 2023-02-16 14:01:22,800 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,801 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,802 INFO [Listener at localhost.localdomain/34581] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43233 connecting to ZooKeeper ensemble=127.0.0.1:58816 2023-02-16 14:01:22,808 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:432330x0, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:22,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43233-0x1016b9760020000 connected 2023-02-16 14:01:22,817 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:22,818 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:22,818 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:22,818 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43233 2023-02-16 14:01:22,819 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43233 2023-02-16 14:01:22,819 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43233 2023-02-16 14:01:22,819 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43233 2023-02-16 14:01:22,819 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43233 2023-02-16 14:01:22,820 INFO [Listener at localhost.localdomain/34581] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7, hbase.cluster.distributed=false 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,833 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:22,834 INFO [Listener at localhost.localdomain/34581] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:22,834 INFO [Listener at localhost.localdomain/34581] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34659 2023-02-16 14:01:22,834 INFO [Listener at localhost.localdomain/34581] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:22,836 DEBUG [Listener at localhost.localdomain/34581] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:22,837 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,837 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,838 INFO [Listener at localhost.localdomain/34581] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34659 connecting to ZooKeeper ensemble=127.0.0.1:58816 2023-02-16 14:01:22,841 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:346590x0, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:22,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34659-0x1016b9760020001 connected 2023-02-16 14:01:22,843 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:22,843 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:22,844 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:22,844 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34659 2023-02-16 14:01:22,846 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34659 2023-02-16 14:01:22,847 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34659 2023-02-16 14:01:22,847 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34659 2023-02-16 14:01:22,847 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34659 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:22,858 INFO [Listener at localhost.localdomain/34581] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:22,859 INFO [Listener at localhost.localdomain/34581] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46155 2023-02-16 14:01:22,859 INFO [Listener at localhost.localdomain/34581] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:22,859 DEBUG [Listener at localhost.localdomain/34581] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:22,860 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,860 INFO [Listener at localhost.localdomain/34581] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,861 INFO [Listener at localhost.localdomain/34581] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46155 connecting to ZooKeeper ensemble=127.0.0.1:58816 2023-02-16 14:01:22,864 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:461550x0, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:22,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46155-0x1016b9760020002 connected 2023-02-16 14:01:22,865 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:22,866 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:22,866 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:22,867 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46155 2023-02-16 14:01:22,867 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46155 2023-02-16 14:01:22,867 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46155 2023-02-16 14:01:22,868 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46155 2023-02-16 14:01:22,868 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46155 2023-02-16 14:01:22,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,877 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:22,877 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,878 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:22,878 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:22,878 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:22,879 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:22,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,43233,1676556082797 from backup master directory 2023-02-16 14:01:22,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:22,882 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,882 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:22,882 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:22,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,895 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/hbase.id with ID: 9f70b47f-06fb-474f-80ad-2479ab94df0f 2023-02-16 14:01:22,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:22,909 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7a97a3c8 to 127.0.0.1:58816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:22,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6312a77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:22,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:22,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:22,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:22,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store-tmp 2023-02-16 14:01:22,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:22,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:22,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:22,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/WALs/jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43233%2C1676556082797, suffix=, logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/WALs/jenkins-hbase20.apache.org,43233,1676556082797, archiveDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:22,952 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK] 2023-02-16 14:01:22,955 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK] 2023-02-16 14:01:22,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/WALs/jenkins-hbase20.apache.org,43233,1676556082797/jenkins-hbase20.apache.org%2C43233%2C1676556082797.1676556082939 2023-02-16 14:01:22,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK], DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK]] 2023-02-16 14:01:22,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:22,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:22,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,959 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:22,959 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:22,960 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:22,960 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,961 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,963 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:22,964 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:22,965 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70701189, jitterRate=0.05352981388568878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:22,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:22,965 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:22,966 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:22,966 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:22,966 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:22,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:22,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:22,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:22,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:22,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:22,978 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:22,978 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:22,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:22,978 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:22,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:22,980 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,981 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:22,981 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:22,982 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:22,982 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:22,982 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:22,982 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:22,982 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,43233,1676556082797, sessionid=0x1016b9760020000, setting cluster-up flag (Was=false) 2023-02-16 14:01:22,985 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,988 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:22,988 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,990 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:22,992 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:22,993 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:22,994 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/.tmp 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:22,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:22,996 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:22,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556112997 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:22,998 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:22,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:22,998 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:23,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556082999,5,FailOnTimeoutGroup] 2023-02-16 14:01:23,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556083000,5,FailOnTimeoutGroup] 2023-02-16 14:01:23,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:23,000 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:23,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,008 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:23,009 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:23,009 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7 2023-02-16 14:01:23,016 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:23,017 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:23,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/info 2023-02-16 14:01:23,018 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:23,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:23,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:23,020 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:23,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:23,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/table 2023-02-16 14:01:23,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:23,022 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,023 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740 2023-02-16 14:01:23,023 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740 2023-02-16 14:01:23,025 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:23,025 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:23,027 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74166362, jitterRate=0.10516491532325745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:23,027 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:23,027 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:23,028 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:23,028 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:23,028 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:23,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:23,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:23,031 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:23,070 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(952): ClusterId : 9f70b47f-06fb-474f-80ad-2479ab94df0f 2023-02-16 14:01:23,070 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:23,070 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(952): ClusterId : 9f70b47f-06fb-474f-80ad-2479ab94df0f 2023-02-16 14:01:23,070 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:23,072 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:23,072 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:23,072 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:23,072 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:23,073 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:23,075 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:23,075 DEBUG [RS:1;jenkins-hbase20:46155] zookeeper.ReadOnlyZKClient(139): Connect 0x797dd7e1 to 127.0.0.1:58816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:23,077 DEBUG [RS:0;jenkins-hbase20:34659] zookeeper.ReadOnlyZKClient(139): Connect 0x2feac447 to 127.0.0.1:58816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:23,086 DEBUG [RS:1;jenkins-hbase20:46155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77ba26be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:23,086 DEBUG [RS:0;jenkins-hbase20:34659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@212d2fca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:23,086 DEBUG [RS:1;jenkins-hbase20:46155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7385bc91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:23,086 DEBUG [RS:0;jenkins-hbase20:34659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2512af37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:23,097 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:46155 2023-02-16 14:01:23,097 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:34659 2023-02-16 14:01:23,097 INFO [RS:1;jenkins-hbase20:46155] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:23,097 INFO [RS:1;jenkins-hbase20:46155] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:23,097 INFO [RS:0;jenkins-hbase20:34659] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:23,097 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:23,097 INFO [RS:0;jenkins-hbase20:34659] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:23,097 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:23,098 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,43233,1676556082797 with isa=jenkins-hbase20.apache.org/148.251.75.209:46155, startcode=1676556082857 2023-02-16 14:01:23,098 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,43233,1676556082797 with isa=jenkins-hbase20.apache.org/148.251.75.209:34659, startcode=1676556082833 2023-02-16 14:01:23,098 DEBUG [RS:0;jenkins-hbase20:34659] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:23,098 DEBUG [RS:1;jenkins-hbase20:46155] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:23,099 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37239, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:23,099 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38365, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:23,101 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43233] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,102 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7 2023-02-16 14:01:23,102 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7 2023-02-16 14:01:23,102 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36277 2023-02-16 14:01:23,102 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36277 2023-02-16 14:01:23,102 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:23,102 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:23,104 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:23,105 DEBUG [RS:0;jenkins-hbase20:34659] zookeeper.ZKUtil(162): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,105 DEBUG [RS:1;jenkins-hbase20:46155] zookeeper.ZKUtil(162): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,105 WARN [RS:0;jenkins-hbase20:34659] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:23,105 WARN [RS:1;jenkins-hbase20:46155] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:23,105 INFO [RS:0;jenkins-hbase20:34659] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:23,105 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34659,1676556082833] 2023-02-16 14:01:23,105 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46155,1676556082857] 2023-02-16 14:01:23,105 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,105 INFO [RS:1;jenkins-hbase20:46155] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:23,106 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,112 DEBUG [RS:0;jenkins-hbase20:34659] zookeeper.ZKUtil(162): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,112 DEBUG [RS:1;jenkins-hbase20:46155] zookeeper.ZKUtil(162): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,112 DEBUG [RS:1;jenkins-hbase20:46155] zookeeper.ZKUtil(162): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,112 DEBUG [RS:0;jenkins-hbase20:34659] zookeeper.ZKUtil(162): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,113 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:23,113 DEBUG [RS:0;jenkins-hbase20:34659] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:23,113 INFO [RS:1;jenkins-hbase20:46155] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:23,113 INFO [RS:0;jenkins-hbase20:34659] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:23,114 INFO [RS:1;jenkins-hbase20:46155] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:23,114 INFO [RS:1;jenkins-hbase20:46155] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:23,114 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,115 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:23,119 INFO [RS:0;jenkins-hbase20:34659] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:23,119 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,124 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,124 INFO [RS:0;jenkins-hbase20:34659] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:23,124 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,124 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,124 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,125 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,125 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:23,125 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,125 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:23,125 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,125 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,126 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,126 DEBUG [RS:1;jenkins-hbase20:46155] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,126 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,127 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,127 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,127 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,127 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,128 DEBUG [RS:0;jenkins-hbase20:34659] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:23,129 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,129 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,129 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,137 INFO [RS:1;jenkins-hbase20:46155] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:23,137 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46155,1676556082857-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,140 INFO [RS:0;jenkins-hbase20:34659] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:23,140 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34659,1676556082833-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,146 INFO [RS:1;jenkins-hbase20:46155] regionserver.Replication(203): jenkins-hbase20.apache.org,46155,1676556082857 started 2023-02-16 14:01:23,146 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,46155,1676556082857, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46155, sessionid=0x1016b9760020002 2023-02-16 14:01:23,146 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:23,146 DEBUG [RS:1;jenkins-hbase20:46155] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,146 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46155,1676556082857' 2023-02-16 14:01:23,146 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46155,1676556082857' 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:23,147 DEBUG [RS:1;jenkins-hbase20:46155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:23,148 DEBUG [RS:1;jenkins-hbase20:46155] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:23,148 INFO [RS:1;jenkins-hbase20:46155] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:23,148 INFO [RS:1;jenkins-hbase20:46155] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:23,154 INFO [RS:0;jenkins-hbase20:34659] regionserver.Replication(203): jenkins-hbase20.apache.org,34659,1676556082833 started 2023-02-16 14:01:23,154 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34659,1676556082833, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34659, sessionid=0x1016b9760020001 2023-02-16 14:01:23,155 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:23,155 DEBUG [RS:0;jenkins-hbase20:34659] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,155 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34659,1676556082833' 2023-02-16 14:01:23,155 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:23,155 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34659,1676556082833' 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:23,156 DEBUG [RS:0;jenkins-hbase20:34659] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:23,156 INFO [RS:0;jenkins-hbase20:34659] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:23,156 INFO [RS:0;jenkins-hbase20:34659] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:23,181 DEBUG [jenkins-hbase20:43233] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:23,181 DEBUG [jenkins-hbase20:43233] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:23,183 DEBUG [jenkins-hbase20:43233] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:23,183 DEBUG [jenkins-hbase20:43233] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:23,183 DEBUG [jenkins-hbase20:43233] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:23,183 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46155,1676556082857, state=OPENING 2023-02-16 14:01:23,184 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:23,185 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:23,185 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:23,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46155,1676556082857}] 2023-02-16 14:01:23,342 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,343 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:23,345 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:23,350 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:23,350 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:23,351 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46155%2C1676556082857.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,46155,1676556082857, archiveDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs, maxLogs=32 2023-02-16 14:01:23,365 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK] 2023-02-16 14:01:23,366 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK] 2023-02-16 14:01:23,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,46155,1676556082857/jenkins-hbase20.apache.org%2C46155%2C1676556082857.meta.1676556083352.meta 2023-02-16 14:01:23,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK], DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK]] 2023-02-16 14:01:23,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:23,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:23,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:23,368 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:23,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:23,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:23,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:23,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:23,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:23,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/info 2023-02-16 14:01:23,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/info 2023-02-16 14:01:23,370 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:23,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:23,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:23,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:23,371 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:23,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:23,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/table 2023-02-16 14:01:23,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/table 2023-02-16 14:01:23,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:23,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740 2023-02-16 14:01:23,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740 2023-02-16 14:01:23,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:23,376 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:23,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64786375, jitterRate=-0.03460778295993805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:23,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:23,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556083342 2023-02-16 14:01:23,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:23,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:23,381 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46155,1676556082857, state=OPEN 2023-02-16 14:01:23,382 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:23,382 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:23,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:23,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46155,1676556082857 in 197 msec 2023-02-16 14:01:23,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:23,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-16 14:01:23,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-16 14:01:23,386 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556083386, completionTime=-1 2023-02-16 14:01:23,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:23,387 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:23,389 DEBUG [hconnection-0x7b468756-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:23,391 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556143392 2023-02-16 14:01:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556203392 2023-02-16 14:01:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 14:01:23,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43233,1676556082797-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43233,1676556082797-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43233,1676556082797-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:43233, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:23,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:23,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:23,405 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:23,406 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:23,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:23,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:23,408 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d empty. 2023-02-16 14:01:23,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:23,418 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:23,419 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ba6d20d2647c9efb064aa6299b58186d, NAME => 'hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ba6d20d2647c9efb064aa6299b58186d, disabling compactions & flushes 2023-02-16 14:01:23,424 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. after waiting 0 ms 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,424 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,424 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ba6d20d2647c9efb064aa6299b58186d: 2023-02-16 14:01:23,426 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:23,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556083427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556083427"}]},"ts":"1676556083427"} 2023-02-16 14:01:23,430 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:23,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:23,431 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556083431"}]},"ts":"1676556083431"} 2023-02-16 14:01:23,432 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:23,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:23,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:23,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:23,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:23,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ba6d20d2647c9efb064aa6299b58186d, ASSIGN}] 2023-02-16 14:01:23,438 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ba6d20d2647c9efb064aa6299b58186d, ASSIGN 2023-02-16 14:01:23,439 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ba6d20d2647c9efb064aa6299b58186d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46155,1676556082857; forceNewPlan=false, retain=false 2023-02-16 14:01:23,589 INFO [jenkins-hbase20:43233] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:23,590 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ba6d20d2647c9efb064aa6299b58186d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556083590"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556083590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556083590"}]},"ts":"1676556083590"} 2023-02-16 14:01:23,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ba6d20d2647c9efb064aa6299b58186d, server=jenkins-hbase20.apache.org,46155,1676556082857}] 2023-02-16 14:01:23,748 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46155%2C1676556082857, suffix=, logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,46155,1676556082857, archiveDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs, maxLogs=32 2023-02-16 14:01:23,759 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK] 2023-02-16 14:01:23,759 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK] 2023-02-16 14:01:23,761 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,46155,1676556082857/jenkins-hbase20.apache.org%2C46155%2C1676556082857.1676556083750 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK], DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK]] 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba6d20d2647c9efb064aa6299b58186d, NAME => 'hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,763 INFO [StoreOpener-ba6d20d2647c9efb064aa6299b58186d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,764 DEBUG [StoreOpener-ba6d20d2647c9efb064aa6299b58186d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/info 2023-02-16 14:01:23,764 DEBUG [StoreOpener-ba6d20d2647c9efb064aa6299b58186d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/info 2023-02-16 14:01:23,764 INFO [StoreOpener-ba6d20d2647c9efb064aa6299b58186d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba6d20d2647c9efb064aa6299b58186d columnFamilyName info 2023-02-16 14:01:23,765 INFO [StoreOpener-ba6d20d2647c9efb064aa6299b58186d-1] regionserver.HStore(310): Store=ba6d20d2647c9efb064aa6299b58186d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:23,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,766 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:23,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:23,769 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ba6d20d2647c9efb064aa6299b58186d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61530526, jitterRate=-0.08312371373176575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:23,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ba6d20d2647c9efb064aa6299b58186d: 2023-02-16 14:01:23,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d., pid=6, masterSystemTime=1676556083745 2023-02-16 14:01:23,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,772 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:23,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ba6d20d2647c9efb064aa6299b58186d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:23,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556083772"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556083772"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556083772"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556083772"}]},"ts":"1676556083772"} 2023-02-16 14:01:23,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:23,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ba6d20d2647c9efb064aa6299b58186d, server=jenkins-hbase20.apache.org,46155,1676556082857 in 180 msec 2023-02-16 14:01:23,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:23,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ba6d20d2647c9efb064aa6299b58186d, ASSIGN in 339 msec 2023-02-16 14:01:23,776 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:23,776 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556083776"}]},"ts":"1676556083776"} 2023-02-16 14:01:23,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:23,778 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:23,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 374 msec 2023-02-16 14:01:23,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:23,807 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:23,807 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:23,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:23,822 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:23,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-16 14:01:23,832 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:23,838 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:23,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 14:01:23,852 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:23,853 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.971sec 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43233,1676556082797-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:23,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43233,1676556082797-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:23,854 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:23,871 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ReadOnlyZKClient(139): Connect 0x236f1ee6 to 127.0.0.1:58816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:23,878 DEBUG [Listener at localhost.localdomain/34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6484864d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:23,880 DEBUG [hconnection-0x469ee9a5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:23,881 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:23,882 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:23,883 DEBUG [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:23,884 DEBUG [Listener at localhost.localdomain/34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:23,886 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:23,886 INFO [Listener at localhost.localdomain/34581] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 14:01:23,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-16 14:01:23,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:23,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:56338 deadline: 1676556143887, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-16 14:01:23,887 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-16 14:01:23,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:23,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:23,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-16 14:01:23,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:23,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:23,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:23,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 empty. 2023-02-16 14:01:23,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:23,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 14:01:23,901 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:23,902 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 13cd4de6225392127a789fa784abbea0, NAME => 'testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp 2023-02-16 14:01:23,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:23,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 13cd4de6225392127a789fa784abbea0, disabling compactions & flushes 2023-02-16 14:01:23,906 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:23,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:23,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. after waiting 0 ms 2023-02-16 14:01:23,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:23,907 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:23,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:23,908 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:23,909 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676556083909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556083909"}]},"ts":"1676556083909"} 2023-02-16 14:01:23,910 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:23,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:23,910 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556083910"}]},"ts":"1676556083910"} 2023-02-16 14:01:23,911 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-16 14:01:23,913 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:23,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:23,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:23,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:23,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, ASSIGN}] 2023-02-16 14:01:23,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, ASSIGN 2023-02-16 14:01:23,916 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46155,1676556082857; forceNewPlan=false, retain=false 2023-02-16 14:01:23,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:24,066 INFO [jenkins-hbase20:43233] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:24,067 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=13cd4de6225392127a789fa784abbea0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,067 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676556084067"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556084067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556084067"}]},"ts":"1676556084067"} 2023-02-16 14:01:24,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 13cd4de6225392127a789fa784abbea0, server=jenkins-hbase20.apache.org,46155,1676556082857}] 2023-02-16 14:01:24,158 INFO [RS:0;jenkins-hbase20:34659] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34659%2C1676556082833, suffix=, logDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,34659,1676556082833, archiveDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs, maxLogs=32 2023-02-16 14:01:24,172 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK] 2023-02-16 14:01:24,175 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK] 2023-02-16 14:01:24,176 INFO [RS:0;jenkins-hbase20:34659] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,34659,1676556082833/jenkins-hbase20.apache.org%2C34659%2C1676556082833.1676556084158 2023-02-16 14:01:24,179 DEBUG [RS:0;jenkins-hbase20:34659] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44965,DS-988047b9-349c-4b9a-8ab8-3c08c0e6f850,DISK], DatanodeInfoWithStorage[127.0.0.1:39907,DS-d1a333c3-ae8d-4024-bc97-c342587f5164,DISK]] 2023-02-16 14:01:24,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:24,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 13cd4de6225392127a789fa784abbea0, NAME => 'testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:24,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:24,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,225 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,226 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1 2023-02-16 14:01:24,226 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1 2023-02-16 14:01:24,226 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13cd4de6225392127a789fa784abbea0 columnFamilyName f1 2023-02-16 14:01:24,226 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(310): Store=13cd4de6225392127a789fa784abbea0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:24,226 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,227 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2 2023-02-16 14:01:24,227 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2 2023-02-16 14:01:24,227 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13cd4de6225392127a789fa784abbea0 columnFamilyName f2 2023-02-16 14:01:24,228 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(310): Store=13cd4de6225392127a789fa784abbea0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:24,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:24,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:24,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:24,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 13cd4de6225392127a789fa784abbea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71345187, jitterRate=0.06312613189220428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:24,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:24,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0., pid=12, masterSystemTime=1676556084220 2023-02-16 14:01:24,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,235 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=13cd4de6225392127a789fa784abbea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,235 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676556084235"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556084235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556084235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556084235"}]},"ts":"1676556084235"} 2023-02-16 14:01:24,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 14:01:24,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 13cd4de6225392127a789fa784abbea0, server=jenkins-hbase20.apache.org,46155,1676556082857 in 168 msec 2023-02-16 14:01:24,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 14:01:24,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, ASSIGN in 323 msec 2023-02-16 14:01:24,238 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:24,239 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556084238"}]},"ts":"1676556084238"} 2023-02-16 14:01:24,240 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-16 14:01:24,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:24,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 351 msec 2023-02-16 14:01:24,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:24,498 INFO [Listener at localhost.localdomain/34581] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-16 14:01:24,498 DEBUG [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-16 14:01:24,499 INFO [Listener at localhost.localdomain/34581] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:24,502 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-16 14:01:24,503 INFO [Listener at localhost.localdomain/34581] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:24,503 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-16 14:01:24,503 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:24,556 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,628 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:24,628 INFO [Listener at localhost.localdomain/34581] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:24,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 14:01:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556084629 (current time:1676556084629). 2023-02-16 14:01:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] zookeeper.ReadOnlyZKClient(139): Connect 0x59236b73 to 127.0.0.1:58816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:24,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6be0170e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:24,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:24,634 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:24,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59236b73 to 127.0.0.1:58816 2023-02-16 14:01:24,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:24,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:24,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 14:01:24,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 14:01:24,638 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 14:01:24,639 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676556684639 2023-02-16 14:01:24,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 14:01:24,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,640 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:24,641 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 14:01:24,641 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:24,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 14:01:24,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-16 14:01:24,642 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 14:01:24,643 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676556684643 2023-02-16 14:01:24,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,649 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 14:01:24,650 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:24,650 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 14:01:24,650 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 14:01:24,651 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,651 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,652 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:24,652 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:24,652 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:24,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:24,652 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,652 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 14:01:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 14:01:24,654 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:24,654 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 14:01:24,654 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:24,654 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46155,1676556082857' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 14:01:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 14:01:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34659,1676556082833' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 14:01:24,656 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,657 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46155,1676556082857' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 14:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67622354[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:24,657 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 14:01:24,658 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:24,658 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,658 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 14:01:24,658 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,34659,1676556082833' in zk 2023-02-16 14:01:24,658 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. started... 2023-02-16 14:01:24,659 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 13cd4de6225392127a789fa784abbea0 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 14:01:24,659 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:24,659 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:24,659 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 14:01:24,671 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f1/f021820ece7445c88159a0ed63f0fc16 2023-02-16 14:01:24,686 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f2/f96836707fac44d88996caa5c19d23b5 2023-02-16 14:01:24,690 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f1/f021820ece7445c88159a0ed63f0fc16 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16 2023-02-16 14:01:24,694 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:24,695 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f2/f96836707fac44d88996caa5c19d23b5 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5 2023-02-16 14:01:24,699 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:24,699 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 13cd4de6225392127a789fa784abbea0 in 40ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16] hfiles 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5] hfiles 2023-02-16 14:01:24,700 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,709 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. completed. 2023-02-16 14:01:24,709 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:24,709 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 14:01:24,709 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 14:01:24,709 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,709 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 14:01:24,709 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,46155,1676556082857' in zk 2023-02-16 14:01:24,710 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,710 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:24,710 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:24,710 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 14:01:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,46155,1676556082857': 2023-02-16 14:01:24,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46155,1676556082857' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:24,713 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 14:01:24,713 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:24,713 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:24,713 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,713 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:24,714 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:24,714 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,714 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:24,715 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:24,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,715 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:24,717 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,717 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,720 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:24,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:24,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:24,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:24,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,720 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:24,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:24,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:24,721 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:24,721 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,721 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:24,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:24,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:24,721 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,721 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,741 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:24,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:24,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:24,743 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:24,756 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-16 14:01:24,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,756 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:24,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676556084639Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676556084720 (+81 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676556084721 (+1 ms)Writing data manifest for testWithMockedMapReduceSingleRegion at 1676556084724 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676556084732 (+8 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676556084756 (+24 ms) 2023-02-16 14:01:24,758 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 14:01:24,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 118 msec 2023-02-16 14:01:24,943 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:24,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 14:01:24,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:24,945 INFO [Listener at localhost.localdomain/34581] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:24,949 INFO [Listener at localhost.localdomain/34581] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:24,954 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:24,981 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,132 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:25,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:25,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,138 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 14:01:25,138 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:25,139 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 14:01:25,139 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 14:01:25,139 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,139 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,140 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:25,140 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:25,141 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,141 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,141 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,142 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 14:01:25,142 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:25,142 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 14:01:25,143 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:25,143 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:25,144 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 14:01:25,144 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34659,1676556082833' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 14:01:25,144 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:25,144 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 14:01:25,144 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:25,144 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,144 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. started... 2023-02-16 14:01:25,144 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 13cd4de6225392127a789fa784abbea0 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 14:01:25,151 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,152 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,152 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:25,162 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f1/e189dcb6670c44e594059659f31b5cb5 2023-02-16 14:01:25,179 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f2/f0ba5fd277b247a68c4de3648ea87b8c 2023-02-16 14:01:25,182 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f1/e189dcb6670c44e594059659f31b5cb5 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/e189dcb6670c44e594059659f31b5cb5 2023-02-16 14:01:25,186 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/e189dcb6670c44e594059659f31b5cb5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:25,187 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/.tmp/f2/f0ba5fd277b247a68c4de3648ea87b8c as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f0ba5fd277b247a68c4de3648ea87b8c 2023-02-16 14:01:25,191 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f0ba5fd277b247a68c4de3648ea87b8c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:25,191 INFO [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 13cd4de6225392127a789fa784abbea0 in 47ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:25,192 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:25,192 DEBUG [rs(jenkins-hbase20.apache.org,46155,1676556082857)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,192 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 14:01:25,192 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 14:01:25,192 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,193 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 14:01:25,193 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46155,1676556082857' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 14:01:25,194 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,194 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:25,194 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,194 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46155,1676556082857' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 14:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@635dab60[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:25,196 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 14:01:25,196 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,196 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,196 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,197 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,197 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,34659,1676556082833' in zk 2023-02-16 14:01:25,197 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,46155,1676556082857' in zk 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,34659,1676556082833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 14:01:25,198 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:25,198 DEBUG [member: 'jenkins-hbase20.apache.org,46155,1676556082857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 14:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,46155,1676556082857': 2023-02-16 14:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46155,1676556082857' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:25,200 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 14:01:25,201 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:25,201 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:25,201 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,201 INFO [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:25,202 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:25,202 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:25,202 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:25,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:25,202 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,203 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,204 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:25,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-16 14:01:25,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,205 DEBUG [(jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:25,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:25,205 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:25,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:25,206 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,307 DEBUG [Listener at localhost.localdomain/34581] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:25,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:25,312 INFO [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676556084629 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:25,312 DEBUG [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4/data/default/testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,312 INFO [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(239): region to add: 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,313 INFO [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(585): clone region=13cd4de6225392127a789fa784abbea0 as 13cd4de6225392127a789fa784abbea0 in snapshot testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,313 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 13cd4de6225392127a789fa784abbea0, NAME => 'testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4 2023-02-16 14:01:25,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:25,319 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f021820ece7445c88159a0ed63f0fc16 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,321 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f96836707fac44d88996caa5c19d23b5 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,323 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 13cd4de6225392127a789fa784abbea0, disabling compactions & flushes 2023-02-16 14:01:25,323 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,323 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,323 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. after waiting 0 ms 2023-02-16 14:01:25,323 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,323 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,323 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:25,323 INFO [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676556084629 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:25,324 DEBUG [Listener at localhost.localdomain/34581] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4 2023-02-16 14:01:25,324 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4 2023-02-16 14:01:25,324 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:25,324 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:25,325 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-16 14:01:25,325 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |----------13cd4de6225392127a789fa784abbea0/ 2023-02-16 14:01:25,325 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:25,325 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:25,326 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=13cd4de6225392127a789fa784abbea0-f021820ece7445c88159a0ed63f0fc16 2023-02-16 14:01:25,326 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:25,326 DEBUG [Listener at localhost.localdomain/34581] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=13cd4de6225392127a789fa784abbea0-f96836707fac44d88996caa5c19d23b5 2023-02-16 14:01:25,329 INFO [Listener at localhost.localdomain/34581] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 14:01:25,335 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:25,335 INFO [Listener at localhost.localdomain/34581] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:25,335 DEBUG [Listener at localhost.localdomain/34581] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:25,337 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,338 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1 2023-02-16 14:01:25,338 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13cd4de6225392127a789fa784abbea0 columnFamilyName f1 2023-02-16 14:01:25,341 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/testWithMockedMapReduceSingleRegion=13cd4de6225392127a789fa784abbea0-f021820ece7445c88159a0ed63f0fc16 2023-02-16 14:01:25,341 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(310): Store=13cd4de6225392127a789fa784abbea0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:25,341 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,342 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2 2023-02-16 14:01:25,342 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13cd4de6225392127a789fa784abbea0 columnFamilyName f2 2023-02-16 14:01:25,345 DEBUG [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36277/user/jenkins/test-data/fe283506-9747-61c2-d82a-73cc55dc6082/testWithMockedMapReduceSingleRegion/6a62ddd7-0df1-492e-a9e4-3bcced6146c4/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/testWithMockedMapReduceSingleRegion=13cd4de6225392127a789fa784abbea0-f96836707fac44d88996caa5c19d23b5 2023-02-16 14:01:25,346 INFO [StoreOpener-13cd4de6225392127a789fa784abbea0-1] regionserver.HStore(310): Store=13cd4de6225392127a789fa784abbea0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:25,346 DEBUG [Listener at localhost.localdomain/34581] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:25,346 INFO [Listener at localhost.localdomain/34581] regionserver.HRegion(1071): Opened 13cd4de6225392127a789fa784abbea0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59834727, jitterRate=-0.10839308798313141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:25,346 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(964): Region open journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:25,387 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(1603): Closing 13cd4de6225392127a789fa784abbea0, disabling compactions & flushes 2023-02-16 14:01:25,387 INFO [Listener at localhost.localdomain/34581] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,387 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,387 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. after waiting 0 ms 2023-02-16 14:01:25,387 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,388 INFO [Listener at localhost.localdomain/34581] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,388 DEBUG [Listener at localhost.localdomain/34581] regionserver.HRegion(1557): Region close journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:25,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-16 14:01:25,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,394 INFO [Listener at localhost.localdomain/34581] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556085397"}]},"ts":"1676556085397"} 2023-02-16 14:01:25,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:25,398 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-16 14:01:25,399 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-16 14:01:25,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, UNASSIGN}] 2023-02-16 14:01:25,400 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, UNASSIGN 2023-02-16 14:01:25,401 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=13cd4de6225392127a789fa784abbea0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676556085401"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556085401"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556085401"}]},"ts":"1676556085401"} 2023-02-16 14:01:25,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 13cd4de6225392127a789fa784abbea0, server=jenkins-hbase20.apache.org,46155,1676556082857}] 2023-02-16 14:01:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:25,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 13cd4de6225392127a789fa784abbea0, disabling compactions & flushes 2023-02-16 14:01:25,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. after waiting 0 ms 2023-02-16 14:01:25,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:25,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0. 2023-02-16 14:01:25,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 13cd4de6225392127a789fa784abbea0: 2023-02-16 14:01:25,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=13cd4de6225392127a789fa784abbea0, regionState=CLOSED 2023-02-16 14:01:25,565 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676556085565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556085565"}]},"ts":"1676556085565"} 2023-02-16 14:01:25,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 14:01:25,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 13cd4de6225392127a789fa784abbea0, server=jenkins-hbase20.apache.org,46155,1676556082857 in 166 msec 2023-02-16 14:01:25,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 14:01:25,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=13cd4de6225392127a789fa784abbea0, UNASSIGN in 168 msec 2023-02-16 14:01:25,570 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556085570"}]},"ts":"1676556085570"} 2023-02-16 14:01:25,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-16 14:01:25,572 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-16 14:01:25,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-16 14:01:25,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:25,702 INFO [Listener at localhost.localdomain/34581] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-16 14:01:25,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,707 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:25,713 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,715 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1, FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2, FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/recovered.edits] 2023-02-16 14:01:25,719 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/e189dcb6670c44e594059659f31b5cb5 to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/archive/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/e189dcb6670c44e594059659f31b5cb5 2023-02-16 14:01:25,720 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16 to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/archive/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f1/f021820ece7445c88159a0ed63f0fc16 2023-02-16 14:01:25,722 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f0ba5fd277b247a68c4de3648ea87b8c to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/archive/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f0ba5fd277b247a68c4de3648ea87b8c 2023-02-16 14:01:25,723 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5 to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/archive/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/f2/f96836707fac44d88996caa5c19d23b5 2023-02-16 14:01:25,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/recovered.edits/12.seqid to hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/archive/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0/recovered.edits/12.seqid 2023-02-16 14:01:25,728 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/.tmp/data/default/testWithMockedMapReduceSingleRegion/13cd4de6225392127a789fa784abbea0 2023-02-16 14:01:25,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 14:01:25,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,730 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-16 14:01:25,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-16 14:01:25,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-16 14:01:25,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556085733"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:25,734 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 14:01:25,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 13cd4de6225392127a789fa784abbea0, NAME => 'testWithMockedMapReduceSingleRegion,,1676556083889.13cd4de6225392127a789fa784abbea0.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 14:01:25,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-16 14:01:25,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556085734"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:25,735 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-16 14:01:25,788 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 14:01:25,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 86 msec 2023-02-16 14:01:25,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43233] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:25,811 INFO [Listener at localhost.localdomain/34581] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-16 14:01:25,811 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:25,811 INFO [Listener at localhost.localdomain/34581] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:25,812 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x236f1ee6 to 127.0.0.1:58816 2023-02-16 14:01:25,812 DEBUG [Listener at localhost.localdomain/34581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:25,812 DEBUG [Listener at localhost.localdomain/34581] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:25,812 DEBUG [Listener at localhost.localdomain/34581] util.JVMClusterUtil(257): Found active master hash=1330391190, stopped=false 2023-02-16 14:01:25,812 INFO [Listener at localhost.localdomain/34581] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:25,847 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:25,847 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:25,847 INFO [Listener at localhost.localdomain/34581] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:25,847 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:25,847 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:25,851 DEBUG [Listener at localhost.localdomain/34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a97a3c8 to 127.0.0.1:58816 2023-02-16 14:01:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:25,852 DEBUG [Listener at localhost.localdomain/34581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:25,852 INFO [Listener at localhost.localdomain/34581] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34659,1676556082833' ***** 2023-02-16 14:01:25,852 INFO [Listener at localhost.localdomain/34581] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:25,852 INFO [Listener at localhost.localdomain/34581] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46155,1676556082857' ***** 2023-02-16 14:01:25,853 INFO [Listener at localhost.localdomain/34581] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:25,853 INFO [RS:0;jenkins-hbase20:34659] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:25,853 INFO [RS:1;jenkins-hbase20:46155] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:25,854 INFO [RS:0;jenkins-hbase20:34659] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:25,854 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:25,854 INFO [RS:0;jenkins-hbase20:34659] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:25,854 INFO [RS:1;jenkins-hbase20:46155] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:25,854 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:25,856 INFO [RS:1;jenkins-hbase20:46155] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:25,856 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,856 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(3304): Received CLOSE for ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:25,856 DEBUG [RS:0;jenkins-hbase20:34659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2feac447 to 127.0.0.1:58816 2023-02-16 14:01:25,856 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:25,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ba6d20d2647c9efb064aa6299b58186d, disabling compactions & flushes 2023-02-16 14:01:25,856 DEBUG [RS:0;jenkins-hbase20:34659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:25,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:25,857 DEBUG [RS:1;jenkins-hbase20:46155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x797dd7e1 to 127.0.0.1:58816 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. after waiting 0 ms 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:25,857 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34659,1676556082833; all regions closed. 2023-02-16 14:01:25,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing ba6d20d2647c9efb064aa6299b58186d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:25,857 DEBUG [RS:1;jenkins-hbase20:46155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:25,857 INFO [RS:1;jenkins-hbase20:46155] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:25,857 INFO [RS:1;jenkins-hbase20:46155] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:25,857 INFO [RS:1;jenkins-hbase20:46155] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:25,857 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:25,857 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 14:01:25,857 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, ba6d20d2647c9efb064aa6299b58186d=hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d.} 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:25,857 DEBUG [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1505): Waiting on 1588230740, ba6d20d2647c9efb064aa6299b58186d 2023-02-16 14:01:25,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:25,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:25,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:25,858 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-16 14:01:25,859 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/WALs/jenkins-hbase20.apache.org,34659,1676556082833/jenkins-hbase20.apache.org%2C34659%2C1676556082833.1676556084158 not finished, retry = 0 2023-02-16 14:01:25,859 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:25,859 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:25,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/.tmp/info/1ff74ada588d44b1b1a640f536df57a3 2023-02-16 14:01:25,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.58 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/info/45b3139d0ac7446180fa88c37d299b47 2023-02-16 14:01:25,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/.tmp/info/1ff74ada588d44b1b1a640f536df57a3 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/info/1ff74ada588d44b1b1a640f536df57a3 2023-02-16 14:01:25,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45b3139d0ac7446180fa88c37d299b47 2023-02-16 14:01:25,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/info/1ff74ada588d44b1b1a640f536df57a3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:25,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ba6d20d2647c9efb064aa6299b58186d in 18ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:25,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/namespace/ba6d20d2647c9efb064aa6299b58186d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:25,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:25,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ba6d20d2647c9efb064aa6299b58186d: 2023-02-16 14:01:25,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556083404.ba6d20d2647c9efb064aa6299b58186d. 2023-02-16 14:01:25,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/rep_barrier/96bca89ee6d041c5a32c73e359c5e4a8 2023-02-16 14:01:25,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96bca89ee6d041c5a32c73e359c5e4a8 2023-02-16 14:01:25,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/table/d4f80a23326049ac9f3e7812f98c5427 2023-02-16 14:01:25,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f80a23326049ac9f3e7812f98c5427 2023-02-16 14:01:25,893 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/info/45b3139d0ac7446180fa88c37d299b47 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/info/45b3139d0ac7446180fa88c37d299b47 2023-02-16 14:01:25,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45b3139d0ac7446180fa88c37d299b47 2023-02-16 14:01:25,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/info/45b3139d0ac7446180fa88c37d299b47, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 14:01:25,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/rep_barrier/96bca89ee6d041c5a32c73e359c5e4a8 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/rep_barrier/96bca89ee6d041c5a32c73e359c5e4a8 2023-02-16 14:01:25,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96bca89ee6d041c5a32c73e359c5e4a8 2023-02-16 14:01:25,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/rep_barrier/96bca89ee6d041c5a32c73e359c5e4a8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 14:01:25,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/.tmp/table/d4f80a23326049ac9f3e7812f98c5427 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/table/d4f80a23326049ac9f3e7812f98c5427 2023-02-16 14:01:25,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f80a23326049ac9f3e7812f98c5427 2023-02-16 14:01:25,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/table/d4f80a23326049ac9f3e7812f98c5427, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 14:01:25,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4316, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 51ms, sequenceid=21, compaction requested=false 2023-02-16 14:01:25,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 14:01:25,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:25,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:25,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:25,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:25,963 DEBUG [RS:0;jenkins-hbase20:34659] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs 2023-02-16 14:01:25,963 INFO [RS:0;jenkins-hbase20:34659] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34659%2C1676556082833:(num 1676556084158) 2023-02-16 14:01:25,963 DEBUG [RS:0;jenkins-hbase20:34659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:25,963 INFO [RS:0;jenkins-hbase20:34659] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:25,963 INFO [RS:0;jenkins-hbase20:34659] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:25,963 INFO [RS:0;jenkins-hbase20:34659] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:25,963 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:25,963 INFO [RS:0;jenkins-hbase20:34659] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:25,964 INFO [RS:0;jenkins-hbase20:34659] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:25,966 INFO [RS:0;jenkins-hbase20:34659] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34659 2023-02-16 14:01:25,970 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,970 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:25,970 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:25,970 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34659,1676556082833 2023-02-16 14:01:25,971 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76dadfc6 rejected from java.util.concurrent.ThreadPoolExecutor@72e545c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:25,971 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:25,971 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@261e2d32 rejected from java.util.concurrent.ThreadPoolExecutor@72e545c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:25,971 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34659,1676556082833] 2023-02-16 14:01:25,971 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34659,1676556082833; numProcessing=1 2023-02-16 14:01:25,972 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34659,1676556082833 already deleted, retry=false 2023-02-16 14:01:25,972 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34659,1676556082833 expired; onlineServers=1 2023-02-16 14:01:26,057 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46155,1676556082857; all regions closed. 2023-02-16 14:01:26,063 DEBUG [RS:1;jenkins-hbase20:46155] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs 2023-02-16 14:01:26,063 INFO [RS:1;jenkins-hbase20:46155] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46155%2C1676556082857.meta:.meta(num 1676556083352) 2023-02-16 14:01:26,072 DEBUG [RS:1;jenkins-hbase20:46155] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/oldWALs 2023-02-16 14:01:26,072 INFO [RS:1;jenkins-hbase20:46155] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46155%2C1676556082857:(num 1676556083750) 2023-02-16 14:01:26,072 DEBUG [RS:1;jenkins-hbase20:46155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:26,072 INFO [RS:1;jenkins-hbase20:46155] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:26,072 INFO [RS:1;jenkins-hbase20:46155] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:26,072 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:26,073 INFO [RS:1;jenkins-hbase20:46155] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46155 2023-02-16 14:01:26,074 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:26,074 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46155,1676556082857 2023-02-16 14:01:26,074 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43c4bf0c rejected from java.util.concurrent.ThreadPoolExecutor@47fb23ac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,074 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46155,1676556082857] 2023-02-16 14:01:26,074 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46155,1676556082857; numProcessing=2 2023-02-16 14:01:26,075 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46155,1676556082857 already deleted, retry=false 2023-02-16 14:01:26,075 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46155,1676556082857 expired; onlineServers=0 2023-02-16 14:01:26,075 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43233,1676556082797' ***** 2023-02-16 14:01:26,075 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:26,076 DEBUG [M:0;jenkins-hbase20:43233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b73a5a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:26,076 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43233,1676556082797 2023-02-16 14:01:26,076 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43233,1676556082797; all regions closed. 2023-02-16 14:01:26,076 DEBUG [M:0;jenkins-hbase20:43233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:26,076 DEBUG [M:0;jenkins-hbase20:43233] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:26,077 DEBUG [M:0;jenkins-hbase20:43233] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:26,077 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:26,077 INFO [M:0;jenkins-hbase20:43233] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:26,077 INFO [M:0;jenkins-hbase20:43233] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:26,077 INFO [M:0;jenkins-hbase20:43233] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:26,077 DEBUG [M:0;jenkins-hbase20:43233] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:26,077 INFO [M:0;jenkins-hbase20:43233] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:26,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556083000] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556083000,5,FailOnTimeoutGroup] 2023-02-16 14:01:26,078 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:26,078 ERROR [M:0;jenkins-hbase20:43233] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:26,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556082999] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556082999,5,FailOnTimeoutGroup] 2023-02-16 14:01:26,079 INFO [M:0;jenkins-hbase20:43233] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:26,079 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:26,080 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:26,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:26,080 DEBUG [M:0;jenkins-hbase20:43233] zookeeper.ZKUtil(398): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:26,080 WARN [M:0;jenkins-hbase20:43233] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:26,080 INFO [M:0;jenkins-hbase20:43233] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:26,081 INFO [M:0;jenkins-hbase20:43233] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:26,081 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:26,081 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:26,081 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:26,081 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:26,081 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:26,081 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.16 KB heapSize=67.12 KB 2023-02-16 14:01:26,093 INFO [M:0;jenkins-hbase20:43233] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.16 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccea938177ba4bc89ab24e91abd820f8 2023-02-16 14:01:26,097 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccea938177ba4bc89ab24e91abd820f8 as hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccea938177ba4bc89ab24e91abd820f8 2023-02-16 14:01:26,100 INFO [M:0;jenkins-hbase20:43233] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36277/user/jenkins/test-data/540a2180-34b6-5429-fa17-cbcc7b3380e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccea938177ba4bc89ab24e91abd820f8, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 14:01:26,101 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegion(2947): Finished flush of dataSize ~56.16 KB/57508, heapSize ~67.10 KB/68712, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-16 14:01:26,101 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:26,101 DEBUG [M:0;jenkins-hbase20:43233] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:26,103 INFO [M:0;jenkins-hbase20:43233] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:26,103 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:26,104 INFO [M:0;jenkins-hbase20:43233] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43233 2023-02-16 14:01:26,109 DEBUG [M:0;jenkins-hbase20:43233] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,43233,1676556082797 already deleted, retry=false 2023-02-16 14:01:26,352 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,352 INFO [M:0;jenkins-hbase20:43233] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43233,1676556082797; zookeeper connection closed. 2023-02-16 14:01:26,352 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@266e3362 rejected from java.util.concurrent.ThreadPoolExecutor@2251b377[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,353 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): master:43233-0x1016b9760020000, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,353 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1dcbc54 rejected from java.util.concurrent.ThreadPoolExecutor@2251b377[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,452 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,452 INFO [RS:1;jenkins-hbase20:46155] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46155,1676556082857; zookeeper connection closed. 2023-02-16 14:01:26,452 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55eb481c rejected from java.util.concurrent.ThreadPoolExecutor@47fb23ac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,454 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f90b604] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f90b604 2023-02-16 14:01:26,454 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x1016b9760020002, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,454 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dc912fb rejected from java.util.concurrent.ThreadPoolExecutor@47fb23ac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,552 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,552 INFO [RS:0;jenkins-hbase20:34659] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34659,1676556082833; zookeeper connection closed. 2023-02-16 14:01:26,552 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e0944b3 rejected from java.util.concurrent.ThreadPoolExecutor@72e545c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,553 DEBUG [Listener at localhost.localdomain/34581-EventThread] zookeeper.ZKWatcher(600): regionserver:34659-0x1016b9760020001, quorum=127.0.0.1:58816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:26,553 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8f55fb4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8f55fb4 2023-02-16 14:01:26,553 ERROR [Listener at localhost.localdomain/34581-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68eac4 rejected from java.util.concurrent.ThreadPoolExecutor@72e545c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:26,553 INFO [Listener at localhost.localdomain/34581] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:26,554 WARN [Listener at localhost.localdomain/34581] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:26,559 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:26,669 WARN [BP-1874064821-148.251.75.209-1676556082157 heartbeating to localhost.localdomain/127.0.0.1:36277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:26,670 WARN [BP-1874064821-148.251.75.209-1676556082157 heartbeating to localhost.localdomain/127.0.0.1:36277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1874064821-148.251.75.209-1676556082157 (Datanode Uuid 40c2e592-521b-4633-b1b2-9d1f8b81117b) service to localhost.localdomain/127.0.0.1:36277 2023-02-16 14:01:26,672 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/dfs/data/data3/current/BP-1874064821-148.251.75.209-1676556082157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:26,672 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/dfs/data/data4/current/BP-1874064821-148.251.75.209-1676556082157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:26,673 WARN [Listener at localhost.localdomain/34581] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:26,678 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:26,789 WARN [BP-1874064821-148.251.75.209-1676556082157 heartbeating to localhost.localdomain/127.0.0.1:36277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:26,789 WARN [BP-1874064821-148.251.75.209-1676556082157 heartbeating to localhost.localdomain/127.0.0.1:36277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1874064821-148.251.75.209-1676556082157 (Datanode Uuid 0d07c789-c7fb-4939-8a5e-7a3a1921374c) service to localhost.localdomain/127.0.0.1:36277 2023-02-16 14:01:26,789 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/dfs/data/data1/current/BP-1874064821-148.251.75.209-1676556082157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:26,790 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/cluster_7d4fb7ee-6095-a45d-b65b-0dbe6e45b2dc/dfs/data/data2/current/BP-1874064821-148.251.75.209-1676556082157] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:26,801 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:26,850 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:26,918 INFO [Listener at localhost.localdomain/34581] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:26,932 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:26,942 INFO [Listener at localhost.localdomain/34581] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=251 (was 230) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:36277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/34581 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/34581.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost.localdomain:36277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:36277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:36277 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,43233,1676556082797)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:36277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:36277 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost.localdomain:36277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=654 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=2742 (was 2889) 2023-02-16 14:01:26,952 INFO [Listener at localhost.localdomain/34581] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=251, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=166, AvailableMemoryMB=2741 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.log.dir so I do NOT create it in target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da 2023-02-16 14:01:26,963 WARN [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.tmp.dir so I do NOT create it in target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da 2023-02-16 14:01:26,963 WARN [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e52379ed-ec17-75c8-562e-5969f48fb35b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:26,963 DEBUG [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec, deleteOnExit=true 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/test.cache.data in system properties and HBase conf 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:26,963 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:26,964 DEBUG [Listener at localhost.localdomain/34581] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:26,964 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:26,965 INFO [Listener at localhost.localdomain/34581] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:26,967 WARN [Listener at localhost.localdomain/34581] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:26,967 WARN [Listener at localhost.localdomain/34581] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:26,993 WARN [Listener at localhost.localdomain/34581] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:26,995 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:26,999 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/java.io.tmpdir/Jetty_localhost_localdomain_44381_hdfs____.jbjc56/webapp 2023-02-16 14:01:27,073 INFO [Listener at localhost.localdomain/34581] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44381 2023-02-16 14:01:27,075 WARN [Listener at localhost.localdomain/34581] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:27,076 WARN [Listener at localhost.localdomain/34581] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:27,101 WARN [Listener at localhost.localdomain/40965] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:27,113 WARN [Listener at localhost.localdomain/40965] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:27,115 WARN [Listener at localhost.localdomain/40965] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:27,116 INFO [Listener at localhost.localdomain/40965] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:27,121 INFO [Listener at localhost.localdomain/40965] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/java.io.tmpdir/Jetty_localhost_42897_datanode____fgp05b/webapp 2023-02-16 14:01:27,223 INFO [Listener at localhost.localdomain/40965] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42897 2023-02-16 14:01:27,250 WARN [Listener at localhost.localdomain/41787] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:27,272 WARN [Listener at localhost.localdomain/41787] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:27,275 WARN [Listener at localhost.localdomain/41787] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:27,276 INFO [Listener at localhost.localdomain/41787] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:27,282 INFO [Listener at localhost.localdomain/41787] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/java.io.tmpdir/Jetty_localhost_38471_datanode____ulb84w/webapp 2023-02-16 14:01:27,329 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6b43fe4cd75168d: Processing first storage report for DS-364fd7aa-5624-4df3-a939-a58aaa716ee0 from datanode 5d9accd4-0f72-4842-af27-31ab4894c89e 2023-02-16 14:01:27,329 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6b43fe4cd75168d: from storage DS-364fd7aa-5624-4df3-a939-a58aaa716ee0 node DatanodeRegistration(127.0.0.1:42517, datanodeUuid=5d9accd4-0f72-4842-af27-31ab4894c89e, infoPort=42163, infoSecurePort=0, ipcPort=41787, storageInfo=lv=-57;cid=testClusterID;nsid=1273333451;c=1676556086969), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:27,329 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6b43fe4cd75168d: Processing first storage report for DS-d2bff5e1-24e9-4bae-906f-faa7dbee7eab from datanode 5d9accd4-0f72-4842-af27-31ab4894c89e 2023-02-16 14:01:27,329 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6b43fe4cd75168d: from storage DS-d2bff5e1-24e9-4bae-906f-faa7dbee7eab node DatanodeRegistration(127.0.0.1:42517, datanodeUuid=5d9accd4-0f72-4842-af27-31ab4894c89e, infoPort=42163, infoSecurePort=0, ipcPort=41787, storageInfo=lv=-57;cid=testClusterID;nsid=1273333451;c=1676556086969), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:27,385 INFO [Listener at localhost.localdomain/41787] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38471 2023-02-16 14:01:27,395 WARN [Listener at localhost.localdomain/36917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:27,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2f5ed2604473a0: Processing first storage report for DS-107d634e-a307-407a-80b1-35de1238011b from datanode 03148247-b06a-4e61-948f-ae4225723534 2023-02-16 14:01:27,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2f5ed2604473a0: from storage DS-107d634e-a307-407a-80b1-35de1238011b node DatanodeRegistration(127.0.0.1:44135, datanodeUuid=03148247-b06a-4e61-948f-ae4225723534, infoPort=34151, infoSecurePort=0, ipcPort=36917, storageInfo=lv=-57;cid=testClusterID;nsid=1273333451;c=1676556086969), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:27,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2f5ed2604473a0: Processing first storage report for DS-6b1d3a0d-387f-454f-92b7-7fcb155c3fd5 from datanode 03148247-b06a-4e61-948f-ae4225723534 2023-02-16 14:01:27,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2f5ed2604473a0: from storage DS-6b1d3a0d-387f-454f-92b7-7fcb155c3fd5 node DatanodeRegistration(127.0.0.1:44135, datanodeUuid=03148247-b06a-4e61-948f-ae4225723534, infoPort=34151, infoSecurePort=0, ipcPort=36917, storageInfo=lv=-57;cid=testClusterID;nsid=1273333451;c=1676556086969), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:27,504 DEBUG [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da 2023-02-16 14:01:27,510 INFO [Listener at localhost.localdomain/36917] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/zookeeper_0, clientPort=52976, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:27,511 INFO [Listener at localhost.localdomain/36917] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52976 2023-02-16 14:01:27,511 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,512 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,528 INFO [Listener at localhost.localdomain/36917] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955 with version=8 2023-02-16 14:01:27,529 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,530 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,531 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40965/user/jenkins/test-data/751fe9fe-36b6-a9b0-7428-316a37109398/hbase-staging 2023-02-16 14:01:27,533 INFO [Listener at localhost.localdomain/36917] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:27,533 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,534 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,534 INFO [Listener at localhost.localdomain/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:27,534 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,534 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:27,534 INFO [Listener at localhost.localdomain/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:27,535 INFO [Listener at localhost.localdomain/36917] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32851 2023-02-16 14:01:27,535 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,536 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,537 INFO [Listener at localhost.localdomain/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32851 connecting to ZooKeeper ensemble=127.0.0.1:52976 2023-02-16 14:01:27,546 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:328510x0, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:27,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32851-0x1016b9772810000 connected 2023-02-16 14:01:27,583 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:27,583 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:27,584 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:27,587 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32851 2023-02-16 14:01:27,587 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32851 2023-02-16 14:01:27,591 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32851 2023-02-16 14:01:27,591 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32851 2023-02-16 14:01:27,592 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32851 2023-02-16 14:01:27,593 INFO [Listener at localhost.localdomain/36917] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955, hbase.cluster.distributed=false 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:27,602 INFO [Listener at localhost.localdomain/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:27,603 INFO [Listener at localhost.localdomain/36917] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33077 2023-02-16 14:01:27,603 INFO [Listener at localhost.localdomain/36917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:27,603 DEBUG [Listener at localhost.localdomain/36917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:27,603 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,604 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,605 INFO [Listener at localhost.localdomain/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33077 connecting to ZooKeeper ensemble=127.0.0.1:52976 2023-02-16 14:01:27,610 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:330770x0, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:27,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33077-0x1016b9772810001 connected 2023-02-16 14:01:27,611 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:27,611 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:27,612 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:27,612 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33077 2023-02-16 14:01:27,612 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33077 2023-02-16 14:01:27,612 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33077 2023-02-16 14:01:27,613 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33077 2023-02-16 14:01:27,613 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33077 2023-02-16 14:01:27,622 INFO [Listener at localhost.localdomain/36917] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:27,623 INFO [Listener at localhost.localdomain/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:27,624 INFO [Listener at localhost.localdomain/36917] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38729 2023-02-16 14:01:27,624 INFO [Listener at localhost.localdomain/36917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:27,624 DEBUG [Listener at localhost.localdomain/36917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:27,625 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,625 INFO [Listener at localhost.localdomain/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,626 INFO [Listener at localhost.localdomain/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38729 connecting to ZooKeeper ensemble=127.0.0.1:52976 2023-02-16 14:01:27,627 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:387290x0, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:27,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38729-0x1016b9772810002 connected 2023-02-16 14:01:27,629 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:27,629 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:27,629 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:27,631 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 14:01:27,631 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38729 2023-02-16 14:01:27,631 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38729 2023-02-16 14:01:27,631 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 14:01:27,631 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 14:01:27,633 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,635 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:27,635 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,636 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:27,636 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:27,636 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:27,636 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,637 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:27,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,32851,1676556087532 from backup master directory 2023-02-16 14:01:27,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:27,640 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,640 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:27,640 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:27,640 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,649 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/hbase.id with ID: d532aa68-4842-42da-bde4-887d6329db29 2023-02-16 14:01:27,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:27,659 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,668 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5a521b09 to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:27,669 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd754f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:27,670 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:27,670 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:27,674 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:27,676 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store-tmp 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:27,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:27,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:27,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/WALs/jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32851%2C1676556087532, suffix=, logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/WALs/jenkins-hbase20.apache.org,32851,1676556087532, archiveDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:27,697 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK] 2023-02-16 14:01:27,697 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK] 2023-02-16 14:01:27,699 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/WALs/jenkins-hbase20.apache.org,32851,1676556087532/jenkins-hbase20.apache.org%2C32851%2C1676556087532.1676556087687 2023-02-16 14:01:27,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK], DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK]] 2023-02-16 14:01:27,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:27,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:27,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,704 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,705 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:27,706 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:27,706 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:27,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,709 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:27,710 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:27,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67896342, jitterRate=0.011734336614608765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:27,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:27,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:27,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:27,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:27,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:27,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:27,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:27,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:27,713 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:27,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:27,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:27,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:27,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:27,723 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:27,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:27,726 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:27,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:27,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:27,728 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:27,728 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:27,728 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:27,728 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,729 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,32851,1676556087532, sessionid=0x1016b9772810000, setting cluster-up flag (Was=false) 2023-02-16 14:01:27,732 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,734 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:27,735 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,736 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,738 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:27,739 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:27,739 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/.tmp 2023-02-16 14:01:27,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:27,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:27,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:27,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:27,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:27,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:27,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:27,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556117744 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:27,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,745 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:27,745 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:27,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:27,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:27,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:27,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:27,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:27,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556087746,5,FailOnTimeoutGroup] 2023-02-16 14:01:27,747 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:27,751 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556087747,5,FailOnTimeoutGroup] 2023-02-16 14:01:27,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:27,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,758 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:27,758 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:27,758 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955 2023-02-16 14:01:27,764 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:27,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:27,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/info 2023-02-16 14:01:27,765 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:27,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:27,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:27,767 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:27,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:27,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:27,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:27,768 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/table 2023-02-16 14:01:27,768 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:27,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:27,769 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740 2023-02-16 14:01:27,769 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740 2023-02-16 14:01:27,770 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:27,771 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:27,772 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:27,773 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73017181, jitterRate=0.0880407840013504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:27,773 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:27,773 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:27,774 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:27,774 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:27,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:27,775 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:27,776 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:27,835 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(952): ClusterId : d532aa68-4842-42da-bde4-887d6329db29 2023-02-16 14:01:27,835 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(952): ClusterId : d532aa68-4842-42da-bde4-887d6329db29 2023-02-16 14:01:27,836 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:27,836 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:27,839 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:27,839 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:27,839 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:27,839 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:27,842 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:27,843 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:27,844 DEBUG [RS:1;jenkins-hbase20:38729] zookeeper.ReadOnlyZKClient(139): Connect 0x4f35035e to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:27,844 DEBUG [RS:0;jenkins-hbase20:33077] zookeeper.ReadOnlyZKClient(139): Connect 0x3fdee73c to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:27,851 DEBUG [RS:0;jenkins-hbase20:33077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31191eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:27,851 DEBUG [RS:0;jenkins-hbase20:33077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35268c4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:27,851 DEBUG [RS:1;jenkins-hbase20:38729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f2f4c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:27,852 DEBUG [RS:1;jenkins-hbase20:38729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45cd682e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:27,859 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:33077 2023-02-16 14:01:27,859 INFO [RS:0;jenkins-hbase20:33077] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:27,859 INFO [RS:0;jenkins-hbase20:33077] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:27,859 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:27,860 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,32851,1676556087532 with isa=jenkins-hbase20.apache.org/148.251.75.209:33077, startcode=1676556087601 2023-02-16 14:01:27,860 DEBUG [RS:0;jenkins-hbase20:33077] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:27,861 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:38729 2023-02-16 14:01:27,861 INFO [RS:1;jenkins-hbase20:38729] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:27,861 INFO [RS:1;jenkins-hbase20:38729] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:27,861 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:27,862 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41123, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:27,862 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,32851,1676556087532 with isa=jenkins-hbase20.apache.org/148.251.75.209:38729, startcode=1676556087622 2023-02-16 14:01:27,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,863 DEBUG [RS:1;jenkins-hbase20:38729] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:27,864 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955 2023-02-16 14:01:27,864 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40965 2023-02-16 14:01:27,864 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:27,865 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:27,865 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57799, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:27,865 DEBUG [RS:0;jenkins-hbase20:33077] zookeeper.ZKUtil(162): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,865 WARN [RS:0;jenkins-hbase20:33077] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:27,865 INFO [RS:0;jenkins-hbase20:33077] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:27,866 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,866 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955 2023-02-16 14:01:27,866 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40965 2023-02-16 14:01:27,866 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:27,868 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33077,1676556087601] 2023-02-16 14:01:27,868 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38729,1676556087622] 2023-02-16 14:01:27,869 DEBUG [RS:1;jenkins-hbase20:38729] zookeeper.ZKUtil(162): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,869 WARN [RS:1;jenkins-hbase20:38729] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:27,869 INFO [RS:1;jenkins-hbase20:38729] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:27,869 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,872 DEBUG [RS:0;jenkins-hbase20:33077] zookeeper.ZKUtil(162): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,872 DEBUG [RS:0;jenkins-hbase20:33077] zookeeper.ZKUtil(162): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,872 DEBUG [RS:1;jenkins-hbase20:38729] zookeeper.ZKUtil(162): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,872 DEBUG [RS:1;jenkins-hbase20:38729] zookeeper.ZKUtil(162): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,873 DEBUG [RS:0;jenkins-hbase20:33077] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:27,873 INFO [RS:0;jenkins-hbase20:33077] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:27,873 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:27,874 INFO [RS:1;jenkins-hbase20:38729] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:27,874 INFO [RS:0;jenkins-hbase20:33077] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:27,874 INFO [RS:0;jenkins-hbase20:33077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:27,874 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,875 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:27,876 INFO [RS:1;jenkins-hbase20:38729] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:27,879 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,879 INFO [RS:1;jenkins-hbase20:38729] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,880 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,880 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,880 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:27,881 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,881 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,881 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,881 DEBUG [RS:0;jenkins-hbase20:33077] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,881 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,882 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,882 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,882 DEBUG [RS:1;jenkins-hbase20:38729] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:27,883 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,883 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,883 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,893 INFO [RS:1;jenkins-hbase20:38729] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:27,893 INFO [RS:0;jenkins-hbase20:33077] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:27,893 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38729,1676556087622-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,893 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33077,1676556087601-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:27,902 INFO [RS:0;jenkins-hbase20:33077] regionserver.Replication(203): jenkins-hbase20.apache.org,33077,1676556087601 started 2023-02-16 14:01:27,902 INFO [RS:1;jenkins-hbase20:38729] regionserver.Replication(203): jenkins-hbase20.apache.org,38729,1676556087622 started 2023-02-16 14:01:27,902 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33077,1676556087601, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33077, sessionid=0x1016b9772810001 2023-02-16 14:01:27,902 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,38729,1676556087622, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38729, sessionid=0x1016b9772810002 2023-02-16 14:01:27,902 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:27,902 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:27,902 DEBUG [RS:0;jenkins-hbase20:33077] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,902 DEBUG [RS:1;jenkins-hbase20:38729] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,902 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33077,1676556087601' 2023-02-16 14:01:27,902 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38729,1676556087622' 2023-02-16 14:01:27,902 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:27,902 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33077,1676556087601' 2023-02-16 14:01:27,903 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38729,1676556087622' 2023-02-16 14:01:27,903 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:27,904 DEBUG [RS:0;jenkins-hbase20:33077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:27,904 DEBUG [RS:1;jenkins-hbase20:38729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:27,904 DEBUG [RS:0;jenkins-hbase20:33077] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:27,904 DEBUG [RS:1;jenkins-hbase20:38729] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:27,904 INFO [RS:0;jenkins-hbase20:33077] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:27,904 INFO [RS:0;jenkins-hbase20:33077] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:27,904 INFO [RS:1;jenkins-hbase20:38729] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:27,904 INFO [RS:1;jenkins-hbase20:38729] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:27,927 DEBUG [jenkins-hbase20:32851] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:27,927 DEBUG [jenkins-hbase20:32851] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:27,928 DEBUG [jenkins-hbase20:32851] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:27,929 DEBUG [jenkins-hbase20:32851] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:27,929 DEBUG [jenkins-hbase20:32851] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:27,929 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38729,1676556087622, state=OPENING 2023-02-16 14:01:27,930 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:27,931 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:27,931 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:27,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38729,1676556087622}] 2023-02-16 14:01:28,089 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:28,089 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:28,092 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:28,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:28,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:28,100 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38729%2C1676556087622.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,38729,1676556087622, archiveDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs, maxLogs=32 2023-02-16 14:01:28,112 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK] 2023-02-16 14:01:28,112 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK] 2023-02-16 14:01:28,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,38729,1676556087622/jenkins-hbase20.apache.org%2C38729%2C1676556087622.meta.1676556088100.meta 2023-02-16 14:01:28,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK], DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK]] 2023-02-16 14:01:28,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:28,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:28,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:28,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:28,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:28,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:28,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:28,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:28,116 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:28,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/info 2023-02-16 14:01:28,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/info 2023-02-16 14:01:28,117 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:28,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:28,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:28,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:28,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:28,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:28,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:28,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:28,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/table 2023-02-16 14:01:28,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/table 2023-02-16 14:01:28,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:28,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:28,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740 2023-02-16 14:01:28,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740 2023-02-16 14:01:28,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:28,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:28,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59963427, jitterRate=-0.10647530853748322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:28,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:28,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556088088 2023-02-16 14:01:28,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:28,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:28,132 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38729,1676556087622, state=OPEN 2023-02-16 14:01:28,133 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:28,133 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:28,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:28,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38729,1676556087622 in 202 msec 2023-02-16 14:01:28,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:28,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-16 14:01:28,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-16 14:01:28,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556088138, completionTime=-1 2023-02-16 14:01:28,139 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:28,139 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:28,140 DEBUG [hconnection-0x76b55798-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:28,141 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:28,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:28,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556148144 2023-02-16 14:01:28,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556208144 2023-02-16 14:01:28,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 14:01:28,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32851,1676556087532-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32851,1676556087532-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32851,1676556087532-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:32851, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:28,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:28,156 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:28,157 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:28,157 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:28,158 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:28,159 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,160 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075 empty. 2023-02-16 14:01:28,160 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,160 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:28,169 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:28,170 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8eb3339d85a0d3d2778e3ffebdf59075, NAME => 'hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp 2023-02-16 14:01:28,176 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:28,176 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8eb3339d85a0d3d2778e3ffebdf59075, disabling compactions & flushes 2023-02-16 14:01:28,177 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. after waiting 0 ms 2023-02-16 14:01:28,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,177 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8eb3339d85a0d3d2778e3ffebdf59075: 2023-02-16 14:01:28,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:28,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556088180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556088180"}]},"ts":"1676556088180"} 2023-02-16 14:01:28,182 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:28,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:28,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556088183"}]},"ts":"1676556088183"} 2023-02-16 14:01:28,185 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:28,188 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:28,189 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:28,189 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:28,189 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:28,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8eb3339d85a0d3d2778e3ffebdf59075, ASSIGN}] 2023-02-16 14:01:28,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8eb3339d85a0d3d2778e3ffebdf59075, ASSIGN 2023-02-16 14:01:28,192 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8eb3339d85a0d3d2778e3ffebdf59075, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38729,1676556087622; forceNewPlan=false, retain=false 2023-02-16 14:01:28,343 INFO [jenkins-hbase20:32851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:28,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8eb3339d85a0d3d2778e3ffebdf59075, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:28,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556088343"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556088343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556088343"}]},"ts":"1676556088343"} 2023-02-16 14:01:28,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8eb3339d85a0d3d2778e3ffebdf59075, server=jenkins-hbase20.apache.org,38729,1676556087622}] 2023-02-16 14:01:28,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38729%2C1676556087622, suffix=, logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,38729,1676556087622, archiveDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs, maxLogs=32 2023-02-16 14:01:28,517 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK] 2023-02-16 14:01:28,517 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK] 2023-02-16 14:01:28,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,38729,1676556087622/jenkins-hbase20.apache.org%2C38729%2C1676556087622.1676556088504 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK], DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK]] 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8eb3339d85a0d3d2778e3ffebdf59075, NAME => 'hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,520 INFO [StoreOpener-8eb3339d85a0d3d2778e3ffebdf59075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,521 DEBUG [StoreOpener-8eb3339d85a0d3d2778e3ffebdf59075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/info 2023-02-16 14:01:28,522 DEBUG [StoreOpener-8eb3339d85a0d3d2778e3ffebdf59075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/info 2023-02-16 14:01:28,522 INFO [StoreOpener-8eb3339d85a0d3d2778e3ffebdf59075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8eb3339d85a0d3d2778e3ffebdf59075 columnFamilyName info 2023-02-16 14:01:28,522 INFO [StoreOpener-8eb3339d85a0d3d2778e3ffebdf59075-1] regionserver.HStore(310): Store=8eb3339d85a0d3d2778e3ffebdf59075/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:28,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:28,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:28,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8eb3339d85a0d3d2778e3ffebdf59075; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69407269, jitterRate=0.03424890339374542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:28,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8eb3339d85a0d3d2778e3ffebdf59075: 2023-02-16 14:01:28,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075., pid=6, masterSystemTime=1676556088496 2023-02-16 14:01:28,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:28,531 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8eb3339d85a0d3d2778e3ffebdf59075, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:28,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556088531"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556088531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556088531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556088531"}]},"ts":"1676556088531"} 2023-02-16 14:01:28,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:28,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8eb3339d85a0d3d2778e3ffebdf59075, server=jenkins-hbase20.apache.org,38729,1676556087622 in 188 msec 2023-02-16 14:01:28,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:28,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8eb3339d85a0d3d2778e3ffebdf59075, ASSIGN in 345 msec 2023-02-16 14:01:28,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:28,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556088536"}]},"ts":"1676556088536"} 2023-02-16 14:01:28,538 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:28,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:28,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-16 14:01:28,557 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:28,557 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:28,558 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:28,565 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:28,573 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:28,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 14:01:28,577 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:28,586 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:28,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-16 14:01:28,602 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:28,603 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.963sec 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32851,1676556087532-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:28,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32851,1676556087532-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:28,605 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:28,636 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ReadOnlyZKClient(139): Connect 0x1bebea36 to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:28,639 DEBUG [Listener at localhost.localdomain/36917] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a77ced, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:28,642 DEBUG [hconnection-0x3d972fdd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:28,645 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:28,647 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:28,647 DEBUG [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:28,651 DEBUG [Listener at localhost.localdomain/36917] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:28,653 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:28,654 INFO [Listener at localhost.localdomain/36917] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:28,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:28,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:28,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 148.251.75.209:50970 deadline: 1676556148654, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:28,656 INFO [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 14:01:28,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:28,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:28,663 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:28,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-16 14:01:28,665 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:28,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:28,667 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:28,668 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 empty. 2023-02-16 14:01:28,668 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:28,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 14:01:28,678 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:28,679 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77fd9875c1262ac1385a4d7f10683dd1, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp 2023-02-16 14:01:28,686 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:28,686 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 77fd9875c1262ac1385a4d7f10683dd1, disabling compactions & flushes 2023-02-16 14:01:28,687 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:28,687 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:28,687 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. after waiting 0 ms 2023-02-16 14:01:28,687 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:28,687 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:28,687 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:28,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:28,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676556088689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556088689"}]},"ts":"1676556088689"} 2023-02-16 14:01:28,690 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:28,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:28,691 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556088691"}]},"ts":"1676556088691"} 2023-02-16 14:01:28,692 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-16 14:01:28,694 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:28,694 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:28,694 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:28,694 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:28,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, ASSIGN}] 2023-02-16 14:01:28,696 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, ASSIGN 2023-02-16 14:01:28,697 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38729,1676556087622; forceNewPlan=false, retain=false 2023-02-16 14:01:28,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:28,847 INFO [jenkins-hbase20:32851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:28,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77fd9875c1262ac1385a4d7f10683dd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:28,848 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676556088847"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556088847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556088847"}]},"ts":"1676556088847"} 2023-02-16 14:01:28,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 77fd9875c1262ac1385a4d7f10683dd1, server=jenkins-hbase20.apache.org,38729,1676556087622}] 2023-02-16 14:01:28,870 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:28,908 INFO [RS:0;jenkins-hbase20:33077] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33077%2C1676556087601, suffix=, logDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,33077,1676556087601, archiveDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs, maxLogs=32 2023-02-16 14:01:28,931 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK] 2023-02-16 14:01:28,931 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK] 2023-02-16 14:01:28,934 INFO [RS:0;jenkins-hbase20:33077] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/WALs/jenkins-hbase20.apache.org,33077,1676556087601/jenkins-hbase20.apache.org%2C33077%2C1676556087601.1676556088909 2023-02-16 14:01:28,934 DEBUG [RS:0;jenkins-hbase20:33077] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42517,DS-364fd7aa-5624-4df3-a939-a58aaa716ee0,DISK], DatanodeInfoWithStorage[127.0.0.1:44135,DS-107d634e-a307-407a-80b1-35de1238011b,DISK]] 2023-02-16 14:01:28,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:29,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77fd9875c1262ac1385a4d7f10683dd1, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,011 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,014 DEBUG [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1 2023-02-16 14:01:29,014 DEBUG [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1 2023-02-16 14:01:29,014 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77fd9875c1262ac1385a4d7f10683dd1 columnFamilyName f1 2023-02-16 14:01:29,015 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] regionserver.HStore(310): Store=77fd9875c1262ac1385a4d7f10683dd1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:29,015 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,016 DEBUG [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2 2023-02-16 14:01:29,016 DEBUG [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2 2023-02-16 14:01:29,016 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77fd9875c1262ac1385a4d7f10683dd1 columnFamilyName f2 2023-02-16 14:01:29,017 INFO [StoreOpener-77fd9875c1262ac1385a4d7f10683dd1-1] regionserver.HStore(310): Store=77fd9875c1262ac1385a4d7f10683dd1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:29,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:29,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:29,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:29,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 77fd9875c1262ac1385a4d7f10683dd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60501366, jitterRate=-0.098459392786026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:29,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:29,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1., pid=12, masterSystemTime=1676556089003 2023-02-16 14:01:29,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77fd9875c1262ac1385a4d7f10683dd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676556089025"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556089025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556089025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556089025"}]},"ts":"1676556089025"} 2023-02-16 14:01:29,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 14:01:29,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 77fd9875c1262ac1385a4d7f10683dd1, server=jenkins-hbase20.apache.org,38729,1676556087622 in 177 msec 2023-02-16 14:01:29,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 14:01:29,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, ASSIGN in 333 msec 2023-02-16 14:01:29,029 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:29,029 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556089029"}]},"ts":"1676556089029"} 2023-02-16 14:01:29,030 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-16 14:01:29,032 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:29,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 372 msec 2023-02-16 14:01:29,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:29,271 INFO [Listener at localhost.localdomain/36917] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-16 14:01:29,272 DEBUG [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-16 14:01:29,272 INFO [Listener at localhost.localdomain/36917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:29,276 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-16 14:01:29,276 INFO [Listener at localhost.localdomain/36917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:29,276 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-16 14:01:29,276 INFO [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:29,310 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,378 INFO [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:29,378 INFO [Listener at localhost.localdomain/36917] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:29,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 14:01:29,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556089379 (current time:1676556089379). 2023-02-16 14:01:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] zookeeper.ReadOnlyZKClient(139): Connect 0x59345f84 to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:29,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52439591, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:29,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:29,385 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55836, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:29,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59345f84 to 127.0.0.1:52976 2023-02-16 14:01:29,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:29,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:29,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 14:01:29,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 14:01:29,389 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 14:01:29,389 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676556689389 2023-02-16 14:01:29,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 14:01:29,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,390 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:29,391 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 14:01:29,391 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:29,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 14:01:29,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-16 14:01:29,393 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 14:01:29,393 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676556689393 2023-02-16 14:01:29,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 14:01:29,401 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 14:01:29,401 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:29,402 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 14:01:29,402 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 14:01:29,403 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,403 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,404 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:29,404 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:29,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:29,404 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:29,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:29,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:29,405 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,405 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 14:01:29,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 14:01:29,406 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 14:01:29,406 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:29,406 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 14:01:29,407 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:29,407 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 14:01:29,408 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 14:01:29,408 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 14:01:29,408 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 14:01:29,408 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33077,1676556087601' joining acquired barrier for procedure (foo) in zk 2023-02-16 14:01:29,408 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38729,1676556087622' joining acquired barrier for procedure (foo) in zk 2023-02-16 14:01:29,409 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,410 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,410 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:29,410 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,410 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:29,410 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,410 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38729,1676556087622' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 14:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@755ee7a9[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:29,412 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 14:01:29,413 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,414 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,414 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,33077,1676556087601' in zk 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 14:01:29,414 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:29,414 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,414 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. started... 2023-02-16 14:01:29,414 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 77fd9875c1262ac1385a4d7f10683dd1 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 14:01:29,415 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 14:01:29,415 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,415 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 14:01:29,432 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f1/5d35fb572c2d418994565b4136943547 2023-02-16 14:01:29,446 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f2/42cb1a0708a944da89e2581704accc40 2023-02-16 14:01:29,451 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f1/5d35fb572c2d418994565b4136943547 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547 2023-02-16 14:01:29,455 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:29,456 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f2/42cb1a0708a944da89e2581704accc40 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40 2023-02-16 14:01:29,460 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:29,461 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 77fd9875c1262ac1385a4d7f10683dd1 in 47ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:29,461 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.' region-info for snapshot=foo 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547] hfiles 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547 for snapshot=foo 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40] hfiles 2023-02-16 14:01:29,462 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40 for snapshot=foo 2023-02-16 14:01:29,469 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. completed. 2023-02-16 14:01:29,469 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,469 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 14:01:29,469 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 14:01:29,469 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,469 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 14:01:29,469 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,38729,1676556087622' in zk 2023-02-16 14:01:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 14:01:29,470 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:29,471 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 14:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,38729,1676556087622': 2023-02-16 14:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38729,1676556087622' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 14:01:29,474 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 14:01:29,474 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:29,474 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:29,474 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 14:01:29,474 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:29,484 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,484 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:29,484 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:29,485 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,486 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,489 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,489 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 14:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,492 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:29,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 14:01:29,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:29,493 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:29,493 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,493 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,493 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:29,493 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 14:01:29,494 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:29,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 14:01:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 14:01:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,494 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,495 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 14:01:29,495 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 14:01:29,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:29,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/foo 2023-02-16 14:01:29,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-16 14:01:29,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:29,526 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.hbase-snapshot/.tmp/foo 2023-02-16 14:01:29,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676556089389Consolidate snapshot: foo at 1676556089494 (+105 ms)Loading Region manifests for foo at 1676556089494Writing data manifest for foo at 1676556089497 (+3 ms)Verifying snapshot: foo at 1676556089504 (+7 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676556089526 (+22 ms) 2023-02-16 14:01:29,528 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 14:01:29,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 138 msec 2023-02-16 14:01:29,693 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:29,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 14:01:29,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:29,695 INFO [Listener at localhost.localdomain/36917] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:29,701 INFO [Listener at localhost.localdomain/36917] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:29,709 INFO [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:29,795 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,884 INFO [Listener at localhost.localdomain/36917] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:29,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:29,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,892 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 14:01:29,892 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:29,893 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-16 14:01:29,893 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-16 14:01:29,893 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,893 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,894 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:29,894 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:29,894 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,895 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,895 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 14:01:29,895 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:29,895 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 14:01:29,896 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:29,896 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 14:01:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 14:01:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 14:01:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33077,1676556087601' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 14:01:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 14:01:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:29,898 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,898 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. started... 2023-02-16 14:01:29,899 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 77fd9875c1262ac1385a4d7f10683dd1 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 14:01:29,914 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f1/77147931fde64a75a8711b8c957a3e89 2023-02-16 14:01:29,931 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f2/ba83736f42e24777bed9ab20c104e12d 2023-02-16 14:01:29,934 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f1/77147931fde64a75a8711b8c957a3e89 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/77147931fde64a75a8711b8c957a3e89 2023-02-16 14:01:29,938 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/77147931fde64a75a8711b8c957a3e89, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:29,939 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/.tmp/f2/ba83736f42e24777bed9ab20c104e12d as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/ba83736f42e24777bed9ab20c104e12d 2023-02-16 14:01:29,943 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/ba83736f42e24777bed9ab20c104e12d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:29,944 INFO [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 77fd9875c1262ac1385a4d7f10683dd1 in 46ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:29,945 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:29,945 DEBUG [rs(jenkins-hbase20.apache.org,38729,1676556087622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:29,945 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 14:01:29,945 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 14:01:29,945 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,945 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 14:01:29,945 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38729,1676556087622' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 14:01:29,946 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,946 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:29,947 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,947 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38729,1676556087622' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-16 14:01:29,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71616dda[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:29,949 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-16 14:01:29,949 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,950 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,38729,1676556087622' in zk 2023-02-16 14:01:29,950 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 14:01:29,950 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,33077,1676556087601' in zk 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 14:01:29,951 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,38729,1676556087622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 14:01:29,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,951 DEBUG [member: 'jenkins-hbase20.apache.org,33077,1676556087601' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 14:01:29,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase20.apache.org,38729,1676556087622': 2023-02-16 14:01:29,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38729,1676556087622' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-16 14:01:29,954 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-16 14:01:29,954 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:29,954 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:29,954 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,954 INFO [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:29,955 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:29,955 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:29,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:29,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:29,956 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:29,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:29,956 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,957 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,958 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:29,959 DEBUG [(jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:29,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks because node does not exist (not an error) 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,959 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:29,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 14:01:29,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:29,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:29,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:29,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:29,960 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:30,060 DEBUG [Listener at localhost.localdomain/36917] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:30,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:30,072 INFO [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676556089379 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:30,072 DEBUG [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40965/user/jenkins/test-data/751fe9fe-36b6-a9b0-7428-316a37109398/foo/28a3fc2c-a966-40cb-91ae-448af609c41e/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,073 INFO [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(239): region to add: 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:30,073 INFO [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(585): clone region=77fd9875c1262ac1385a4d7f10683dd1 as 77fd9875c1262ac1385a4d7f10683dd1 in snapshot foo 2023-02-16 14:01:30,074 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77fd9875c1262ac1385a4d7f10683dd1, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40965/user/jenkins/test-data/751fe9fe-36b6-a9b0-7428-316a37109398/foo/28a3fc2c-a966-40cb-91ae-448af609c41e 2023-02-16 14:01:30,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:30,085 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d35fb572c2d418994565b4136943547 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,086 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 42cb1a0708a944da89e2581704accc40 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,088 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 77fd9875c1262ac1385a4d7f10683dd1, disabling compactions & flushes 2023-02-16 14:01:30,088 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,088 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,088 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. after waiting 0 ms 2023-02-16 14:01:30,088 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,088 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,088 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:30,090 INFO [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676556089379 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:30,090 DEBUG [Listener at localhost.localdomain/36917] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40965/user/jenkins/test-data/751fe9fe-36b6-a9b0-7428-316a37109398/foo/28a3fc2c-a966-40cb-91ae-448af609c41e 2023-02-16 14:01:30,090 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40965/user/jenkins/test-data/751fe9fe-36b6-a9b0-7428-316a37109398/foo/28a3fc2c-a966-40cb-91ae-448af609c41e 2023-02-16 14:01:30,090 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:30,091 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:30,091 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-16 14:01:30,091 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |----------77fd9875c1262ac1385a4d7f10683dd1/ 2023-02-16 14:01:30,092 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:30,092 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:30,092 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=77fd9875c1262ac1385a4d7f10683dd1-5d35fb572c2d418994565b4136943547 2023-02-16 14:01:30,092 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:30,093 DEBUG [Listener at localhost.localdomain/36917] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=77fd9875c1262ac1385a4d7f10683dd1-42cb1a0708a944da89e2581704accc40 hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547 hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/77147931fde64a75a8711b8c957a3e89 hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40 hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/ba83736f42e24777bed9ab20c104e12d 2023-02-16 14:01:30,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-16 14:01:30,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 14:01:30,102 INFO [Listener at localhost.localdomain/36917] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:30,105 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556090105"}]},"ts":"1676556090105"} 2023-02-16 14:01:30,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-16 14:01:30,122 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-16 14:01:30,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, UNASSIGN}] 2023-02-16 14:01:30,125 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, UNASSIGN 2023-02-16 14:01:30,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77fd9875c1262ac1385a4d7f10683dd1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:30,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676556090126"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556090126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556090126"}]},"ts":"1676556090126"} 2023-02-16 14:01:30,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 77fd9875c1262ac1385a4d7f10683dd1, server=jenkins-hbase20.apache.org,38729,1676556087622}] 2023-02-16 14:01:30,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:30,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:30,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 77fd9875c1262ac1385a4d7f10683dd1, disabling compactions & flushes 2023-02-16 14:01:30,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. after waiting 0 ms 2023-02-16 14:01:30,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:30,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1. 2023-02-16 14:01:30,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 77fd9875c1262ac1385a4d7f10683dd1: 2023-02-16 14:01:30,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:30,287 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77fd9875c1262ac1385a4d7f10683dd1, regionState=CLOSED 2023-02-16 14:01:30,287 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676556090287"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556090287"}]},"ts":"1676556090287"} 2023-02-16 14:01:30,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 14:01:30,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 77fd9875c1262ac1385a4d7f10683dd1, server=jenkins-hbase20.apache.org,38729,1676556087622 in 161 msec 2023-02-16 14:01:30,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 14:01:30,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=77fd9875c1262ac1385a4d7f10683dd1, UNASSIGN in 167 msec 2023-02-16 14:01:30,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556090292"}]},"ts":"1676556090292"} 2023-02-16 14:01:30,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-16 14:01:30,294 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-16 14:01:30,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 194 msec 2023-02-16 14:01:30,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:30,408 INFO [Listener at localhost.localdomain/36917] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-16 14:01:30,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,412 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,413 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:30,417 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:30,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1, FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2, FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/recovered.edits] 2023-02-16 14:01:30,424 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547 to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/5d35fb572c2d418994565b4136943547 2023-02-16 14:01:30,425 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/77147931fde64a75a8711b8c957a3e89 to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f1/77147931fde64a75a8711b8c957a3e89 2023-02-16 14:01:30,428 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40 to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/42cb1a0708a944da89e2581704accc40 2023-02-16 14:01:30,430 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/ba83736f42e24777bed9ab20c104e12d to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/f2/ba83736f42e24777bed9ab20c104e12d 2023-02-16 14:01:30,433 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/recovered.edits/12.seqid to hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1/recovered.edits/12.seqid 2023-02-16 14:01:30,433 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/77fd9875c1262ac1385a4d7f10683dd1 2023-02-16 14:01:30,434 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 14:01:30,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,439 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-16 14:01:30,440 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-16 14:01:30,445 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,445 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-16 14:01:30,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556090446"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:30,448 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 14:01:30,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77fd9875c1262ac1385a4d7f10683dd1, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676556088659.77fd9875c1262ac1385a4d7f10683dd1.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 14:01:30,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-16 14:01:30,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556090448"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:30,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-16 14:01:30,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 14:01:30,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 44 msec 2023-02-16 14:01:30,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32851] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:30,515 INFO [Listener at localhost.localdomain/36917] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-16 14:01:30,515 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:30,516 INFO [Listener at localhost.localdomain/36917] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:30,516 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bebea36 to 127.0.0.1:52976 2023-02-16 14:01:30,516 DEBUG [Listener at localhost.localdomain/36917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,516 DEBUG [Listener at localhost.localdomain/36917] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:30,516 DEBUG [Listener at localhost.localdomain/36917] util.JVMClusterUtil(257): Found active master hash=1456366345, stopped=false 2023-02-16 14:01:30,516 INFO [Listener at localhost.localdomain/36917] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:30,517 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:30,517 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:30,517 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:30,517 INFO [Listener at localhost.localdomain/36917] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:30,517 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:30,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:30,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:30,518 DEBUG [Listener at localhost.localdomain/36917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a521b09 to 127.0.0.1:52976 2023-02-16 14:01:30,518 DEBUG [Listener at localhost.localdomain/36917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:30,519 INFO [Listener at localhost.localdomain/36917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33077,1676556087601' ***** 2023-02-16 14:01:30,519 INFO [Listener at localhost.localdomain/36917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:30,519 INFO [Listener at localhost.localdomain/36917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,38729,1676556087622' ***** 2023-02-16 14:01:30,519 INFO [Listener at localhost.localdomain/36917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:30,520 INFO [RS:0;jenkins-hbase20:33077] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:30,520 INFO [RS:1;jenkins-hbase20:38729] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:30,520 INFO [RS:0;jenkins-hbase20:33077] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:30,520 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:30,520 INFO [RS:0;jenkins-hbase20:33077] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:30,520 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:30,520 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:30,520 INFO [RS:1;jenkins-hbase20:38729] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:30,521 DEBUG [RS:0;jenkins-hbase20:33077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fdee73c to 127.0.0.1:52976 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:30,521 DEBUG [RS:0;jenkins-hbase20:33077] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(3304): Received CLOSE for 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:30,521 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33077,1676556087601; all regions closed. 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:30,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8eb3339d85a0d3d2778e3ffebdf59075, disabling compactions & flushes 2023-02-16 14:01:30,521 DEBUG [RS:1;jenkins-hbase20:38729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f35035e to 127.0.0.1:52976 2023-02-16 14:01:30,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:30,521 DEBUG [RS:1;jenkins-hbase20:38729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:30,521 INFO [RS:1;jenkins-hbase20:38729] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:30,522 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:30,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. after waiting 0 ms 2023-02-16 14:01:30,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:30,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 8eb3339d85a0d3d2778e3ffebdf59075 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:30,523 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 14:01:30,523 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 8eb3339d85a0d3d2778e3ffebdf59075=hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075.} 2023-02-16 14:01:30,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:30,523 DEBUG [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1505): Waiting on 1588230740, 8eb3339d85a0d3d2778e3ffebdf59075 2023-02-16 14:01:30,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:30,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:30,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:30,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:30,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.47 KB heapSize=7.87 KB 2023-02-16 14:01:30,526 DEBUG [RS:0;jenkins-hbase20:33077] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs 2023-02-16 14:01:30,526 INFO [RS:0;jenkins-hbase20:33077] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33077%2C1676556087601:(num 1676556088909) 2023-02-16 14:01:30,526 DEBUG [RS:0;jenkins-hbase20:33077] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,526 INFO [RS:0;jenkins-hbase20:33077] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:30,526 INFO [RS:0;jenkins-hbase20:33077] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:30,527 INFO [RS:0;jenkins-hbase20:33077] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:30,527 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:30,527 INFO [RS:0;jenkins-hbase20:33077] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:30,527 INFO [RS:0;jenkins-hbase20:33077] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:30,528 INFO [RS:0;jenkins-hbase20:33077] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33077 2023-02-16 14:01:30,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/.tmp/info/c733cfd042954f0395eb35e747bd0184 2023-02-16 14:01:30,533 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/info/6907f75deaa944cb8dbafb00040daaac 2023-02-16 14:01:30,535 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:30,535 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33077,1676556087601 2023-02-16 14:01:30,535 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:30,535 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b70978b rejected from java.util.concurrent.ThreadPoolExecutor@7f4f1c3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:30,535 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:30,535 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:30,535 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@740e88ab rejected from java.util.concurrent.ThreadPoolExecutor@7f4f1c3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:30,536 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33077,1676556087601] 2023-02-16 14:01:30,537 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33077,1676556087601; numProcessing=1 2023-02-16 14:01:30,537 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33077,1676556087601 already deleted, retry=false 2023-02-16 14:01:30,537 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33077,1676556087601 expired; onlineServers=1 2023-02-16 14:01:30,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/.tmp/info/c733cfd042954f0395eb35e747bd0184 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/info/c733cfd042954f0395eb35e747bd0184 2023-02-16 14:01:30,539 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6907f75deaa944cb8dbafb00040daaac 2023-02-16 14:01:30,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/info/c733cfd042954f0395eb35e747bd0184, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:30,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8eb3339d85a0d3d2778e3ffebdf59075 in 21ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:30,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/rep_barrier/6021aae8bc764b5eadfba3ef37eba2fc 2023-02-16 14:01:30,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/namespace/8eb3339d85a0d3d2778e3ffebdf59075/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:30,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:30,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8eb3339d85a0d3d2778e3ffebdf59075: 2023-02-16 14:01:30,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556088155.8eb3339d85a0d3d2778e3ffebdf59075. 2023-02-16 14:01:30,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6021aae8bc764b5eadfba3ef37eba2fc 2023-02-16 14:01:30,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/table/36ed759d77e848fe8947fdebde5873c4 2023-02-16 14:01:30,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36ed759d77e848fe8947fdebde5873c4 2023-02-16 14:01:30,567 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/info/6907f75deaa944cb8dbafb00040daaac as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/info/6907f75deaa944cb8dbafb00040daaac 2023-02-16 14:01:30,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6907f75deaa944cb8dbafb00040daaac 2023-02-16 14:01:30,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/info/6907f75deaa944cb8dbafb00040daaac, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 14:01:30,578 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/rep_barrier/6021aae8bc764b5eadfba3ef37eba2fc as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/rep_barrier/6021aae8bc764b5eadfba3ef37eba2fc 2023-02-16 14:01:30,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6021aae8bc764b5eadfba3ef37eba2fc 2023-02-16 14:01:30,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/rep_barrier/6021aae8bc764b5eadfba3ef37eba2fc, entries=1, sequenceid=21, filesize=5.1 K 2023-02-16 14:01:30,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/.tmp/table/36ed759d77e848fe8947fdebde5873c4 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/table/36ed759d77e848fe8947fdebde5873c4 2023-02-16 14:01:30,585 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:30,586 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:30,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36ed759d77e848fe8947fdebde5873c4 2023-02-16 14:01:30,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/table/36ed759d77e848fe8947fdebde5873c4, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 14:01:30,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.47 KB/4577, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=21, compaction requested=false 2023-02-16 14:01:30,594 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 14:01:30,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:30,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:30,596 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:30,596 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:30,719 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:30,719 INFO [RS:0;jenkins-hbase20:33077] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33077,1676556087601; zookeeper connection closed. 2023-02-16 14:01:30,719 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c94cec0 rejected from java.util.concurrent.ThreadPoolExecutor@7f4f1c3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:30,719 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:33077-0x1016b9772810001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:30,719 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f28fb1c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f28fb1c 2023-02-16 14:01:30,719 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a29e2c8 rejected from java.util.concurrent.ThreadPoolExecutor@7f4f1c3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:30,723 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,38729,1676556087622; all regions closed. 2023-02-16 14:01:30,730 DEBUG [RS:1;jenkins-hbase20:38729] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs 2023-02-16 14:01:30,730 INFO [RS:1;jenkins-hbase20:38729] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38729%2C1676556087622.meta:.meta(num 1676556088100) 2023-02-16 14:01:30,734 DEBUG [RS:1;jenkins-hbase20:38729] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/oldWALs 2023-02-16 14:01:30,734 INFO [RS:1;jenkins-hbase20:38729] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38729%2C1676556087622:(num 1676556088504) 2023-02-16 14:01:30,735 DEBUG [RS:1;jenkins-hbase20:38729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,735 INFO [RS:1;jenkins-hbase20:38729] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:30,735 INFO [RS:1;jenkins-hbase20:38729] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:30,735 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:30,736 INFO [RS:1;jenkins-hbase20:38729] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38729 2023-02-16 14:01:30,737 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38729,1676556087622 2023-02-16 14:01:30,737 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:30,737 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@256df406 rejected from java.util.concurrent.ThreadPoolExecutor@21526473[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:30,739 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38729,1676556087622] 2023-02-16 14:01:30,740 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38729,1676556087622; numProcessing=2 2023-02-16 14:01:30,740 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38729,1676556087622 already deleted, retry=false 2023-02-16 14:01:30,740 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38729,1676556087622 expired; onlineServers=0 2023-02-16 14:01:30,740 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,32851,1676556087532' ***** 2023-02-16 14:01:30,740 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:30,741 DEBUG [M:0;jenkins-hbase20:32851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52f1ed08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:30,741 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,32851,1676556087532 2023-02-16 14:01:30,741 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,32851,1676556087532; all regions closed. 2023-02-16 14:01:30,741 DEBUG [M:0;jenkins-hbase20:32851] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:30,741 DEBUG [M:0;jenkins-hbase20:32851] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:30,741 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:30,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556087746] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556087746,5,FailOnTimeoutGroup] 2023-02-16 14:01:30,741 DEBUG [M:0;jenkins-hbase20:32851] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:30,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556087747] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556087747,5,FailOnTimeoutGroup] 2023-02-16 14:01:30,742 INFO [M:0;jenkins-hbase20:32851] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:30,743 INFO [M:0;jenkins-hbase20:32851] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:30,743 INFO [M:0;jenkins-hbase20:32851] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:30,743 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:30,743 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:30,743 DEBUG [M:0;jenkins-hbase20:32851] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:30,743 INFO [M:0;jenkins-hbase20:32851] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:30,744 ERROR [M:0;jenkins-hbase20:32851] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:30,744 INFO [M:0;jenkins-hbase20:32851] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:30,744 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:30,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:30,744 DEBUG [M:0;jenkins-hbase20:32851] zookeeper.ZKUtil(398): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:30,744 WARN [M:0;jenkins-hbase20:32851] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:30,745 INFO [M:0;jenkins-hbase20:32851] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:30,745 INFO [M:0;jenkins-hbase20:32851] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:30,746 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:30,746 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:30,746 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:30,746 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:30,746 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:30,746 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.71 KB heapSize=67.67 KB 2023-02-16 14:01:30,759 INFO [M:0;jenkins-hbase20:32851] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ba73d6f574246078c913572810884c9 2023-02-16 14:01:30,762 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ba73d6f574246078c913572810884c9 as hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ba73d6f574246078c913572810884c9 2023-02-16 14:01:30,766 INFO [M:0;jenkins-hbase20:32851] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40965/user/jenkins/test-data/53cb67a9-71cf-fc61-15d7-c2716506c955/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ba73d6f574246078c913572810884c9, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 14:01:30,767 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegion(2947): Finished flush of dataSize ~56.71 KB/58066, heapSize ~67.66 KB/69280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-16 14:01:30,767 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:30,767 DEBUG [M:0;jenkins-hbase20:32851] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:30,770 INFO [M:0;jenkins-hbase20:32851] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:30,770 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:30,771 INFO [M:0;jenkins-hbase20:32851] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32851 2023-02-16 14:01:30,772 DEBUG [M:0;jenkins-hbase20:32851] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,32851,1676556087532 already deleted, retry=false 2023-02-16 14:01:31,120 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:31,120 INFO [M:0;jenkins-hbase20:32851] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,32851,1676556087532; zookeeper connection closed. 2023-02-16 14:01:31,120 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@603b1672 rejected from java.util.concurrent.ThreadPoolExecutor@64049ead[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:31,121 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): master:32851-0x1016b9772810000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:31,121 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@285d57a9 rejected from java.util.concurrent.ThreadPoolExecutor@64049ead[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:31,221 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:31,221 INFO [RS:1;jenkins-hbase20:38729] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,38729,1676556087622; zookeeper connection closed. 2023-02-16 14:01:31,221 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ff927a3 rejected from java.util.concurrent.ThreadPoolExecutor@21526473[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:31,221 DEBUG [Listener at localhost.localdomain/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:38729-0x1016b9772810002, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:31,221 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9f8233f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9f8233f 2023-02-16 14:01:31,221 ERROR [Listener at localhost.localdomain/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67bdbaae rejected from java.util.concurrent.ThreadPoolExecutor@21526473[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:31,222 INFO [Listener at localhost.localdomain/36917] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:31,222 WARN [Listener at localhost.localdomain/36917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:31,230 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:31,334 WARN [BP-1960993120-148.251.75.209-1676556086969 heartbeating to localhost.localdomain/127.0.0.1:40965] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:31,334 WARN [BP-1960993120-148.251.75.209-1676556086969 heartbeating to localhost.localdomain/127.0.0.1:40965] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1960993120-148.251.75.209-1676556086969 (Datanode Uuid 03148247-b06a-4e61-948f-ae4225723534) service to localhost.localdomain/127.0.0.1:40965 2023-02-16 14:01:31,335 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/dfs/data/data3/current/BP-1960993120-148.251.75.209-1676556086969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:31,336 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/dfs/data/data4/current/BP-1960993120-148.251.75.209-1676556086969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:31,337 WARN [Listener at localhost.localdomain/36917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:31,340 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:31,450 WARN [BP-1960993120-148.251.75.209-1676556086969 heartbeating to localhost.localdomain/127.0.0.1:40965] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:31,450 WARN [BP-1960993120-148.251.75.209-1676556086969 heartbeating to localhost.localdomain/127.0.0.1:40965] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1960993120-148.251.75.209-1676556086969 (Datanode Uuid 5d9accd4-0f72-4842-af27-31ab4894c89e) service to localhost.localdomain/127.0.0.1:40965 2023-02-16 14:01:31,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/dfs/data/data1/current/BP-1960993120-148.251.75.209-1676556086969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:31,451 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/cluster_e7adb08b-14db-cd55-2e22-13eb789032ec/dfs/data/data2/current/BP-1960993120-148.251.75.209-1676556086969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:31,468 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:31,587 INFO [Listener at localhost.localdomain/36917] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:31,616 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:31,632 INFO [Listener at localhost.localdomain/36917] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=270 (was 251) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36917 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40965 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,32851,1676556087532)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost.localdomain:40965 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40965 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:40965 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost.localdomain:40965 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=566 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 265), ProcessCount=166 (was 166), AvailableMemoryMB=2669 (was 2741) 2023-02-16 14:01:31,645 INFO [Listener at localhost.localdomain/36917] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=270, OpenFileDescriptor=566, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=166, AvailableMemoryMB=2669 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.log.dir so I do NOT create it in target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8 2023-02-16 14:01:31,653 WARN [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.tmp.dir so I do NOT create it in target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8 2023-02-16 14:01:31,653 WARN [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8a92988-c14b-9708-7a1c-06bff42371da/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 14:01:31,653 DEBUG [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d, deleteOnExit=true 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/test.cache.data in system properties and HBase conf 2023-02-16 14:01:31,653 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/hadoop.log.dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 14:01:31,654 DEBUG [Listener at localhost.localdomain/36917] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 14:01:31,654 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/nfs.dump.dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/java.io.tmpdir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 14:01:31,655 INFO [Listener at localhost.localdomain/36917] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 14:01:31,657 WARN [Listener at localhost.localdomain/36917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:31,657 WARN [Listener at localhost.localdomain/36917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:31,681 WARN [Listener at localhost.localdomain/36917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:31,682 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:31,687 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/java.io.tmpdir/Jetty_localhost_localdomain_36701_hdfs____.w1h52p/webapp 2023-02-16 14:01:31,763 INFO [Listener at localhost.localdomain/36917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36701 2023-02-16 14:01:31,766 WARN [Listener at localhost.localdomain/36917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 14:01:31,766 WARN [Listener at localhost.localdomain/36917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 14:01:31,791 WARN [Listener at localhost.localdomain/42835] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:31,802 WARN [Listener at localhost.localdomain/42835] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:31,805 WARN [Listener at localhost.localdomain/42835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:31,806 INFO [Listener at localhost.localdomain/42835] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:31,810 INFO [Listener at localhost.localdomain/42835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/java.io.tmpdir/Jetty_localhost_36393_datanode____.3voudr/webapp 2023-02-16 14:01:31,895 INFO [Listener at localhost.localdomain/42835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36393 2023-02-16 14:01:31,915 WARN [Listener at localhost.localdomain/36695] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:31,951 WARN [Listener at localhost.localdomain/36695] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 14:01:31,953 WARN [Listener at localhost.localdomain/36695] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 14:01:31,954 INFO [Listener at localhost.localdomain/36695] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 14:01:31,957 INFO [Listener at localhost.localdomain/36695] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/java.io.tmpdir/Jetty_localhost_41115_datanode____.2zslgh/webapp 2023-02-16 14:01:32,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x931514296bd96683: Processing first storage report for DS-019d168e-5697-4336-a50d-7a8edb3fea5c from datanode 52ab66d3-c8b1-4c40-b409-c4d6c8e144fd 2023-02-16 14:01:32,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x931514296bd96683: from storage DS-019d168e-5697-4336-a50d-7a8edb3fea5c node DatanodeRegistration(127.0.0.1:44551, datanodeUuid=52ab66d3-c8b1-4c40-b409-c4d6c8e144fd, infoPort=37597, infoSecurePort=0, ipcPort=36695, storageInfo=lv=-57;cid=testClusterID;nsid=1935805369;c=1676556091659), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:32,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x931514296bd96683: Processing first storage report for DS-effe5f1d-365b-49f2-83c8-7b7c72c271f8 from datanode 52ab66d3-c8b1-4c40-b409-c4d6c8e144fd 2023-02-16 14:01:32,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x931514296bd96683: from storage DS-effe5f1d-365b-49f2-83c8-7b7c72c271f8 node DatanodeRegistration(127.0.0.1:44551, datanodeUuid=52ab66d3-c8b1-4c40-b409-c4d6c8e144fd, infoPort=37597, infoSecurePort=0, ipcPort=36695, storageInfo=lv=-57;cid=testClusterID;nsid=1935805369;c=1676556091659), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:32,059 INFO [Listener at localhost.localdomain/36695] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41115 2023-02-16 14:01:32,073 WARN [Listener at localhost.localdomain/40075] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 14:01:32,155 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92821d21ad445e7b: Processing first storage report for DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f from datanode 30dc5c74-a980-482b-bb23-6bea22900e2a 2023-02-16 14:01:32,155 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92821d21ad445e7b: from storage DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f node DatanodeRegistration(127.0.0.1:34557, datanodeUuid=30dc5c74-a980-482b-bb23-6bea22900e2a, infoPort=42979, infoSecurePort=0, ipcPort=40075, storageInfo=lv=-57;cid=testClusterID;nsid=1935805369;c=1676556091659), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:32,155 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92821d21ad445e7b: Processing first storage report for DS-8128313c-a2f6-464f-b281-9f6c1067b2a6 from datanode 30dc5c74-a980-482b-bb23-6bea22900e2a 2023-02-16 14:01:32,155 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92821d21ad445e7b: from storage DS-8128313c-a2f6-464f-b281-9f6c1067b2a6 node DatanodeRegistration(127.0.0.1:34557, datanodeUuid=30dc5c74-a980-482b-bb23-6bea22900e2a, infoPort=42979, infoSecurePort=0, ipcPort=40075, storageInfo=lv=-57;cid=testClusterID;nsid=1935805369;c=1676556091659), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 14:01:32,181 DEBUG [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8 2023-02-16 14:01:32,185 INFO [Listener at localhost.localdomain/40075] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/zookeeper_0, clientPort=57880, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 14:01:32,186 INFO [Listener at localhost.localdomain/40075] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57880 2023-02-16 14:01:32,186 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,187 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,207 INFO [Listener at localhost.localdomain/40075] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073 with version=8 2023-02-16 14:01:32,207 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,208 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,209 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/hbase-staging 2023-02-16 14:01:32,210 INFO [Listener at localhost.localdomain/40075] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:32,210 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,210 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,211 INFO [Listener at localhost.localdomain/40075] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:32,211 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,211 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:32,211 INFO [Listener at localhost.localdomain/40075] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:32,211 INFO [Listener at localhost.localdomain/40075] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38681 2023-02-16 14:01:32,212 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,212 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,213 INFO [Listener at localhost.localdomain/40075] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38681 connecting to ZooKeeper ensemble=127.0.0.1:57880 2023-02-16 14:01:32,220 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:386810x0, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:32,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38681-0x1016b9784c60000 connected 2023-02-16 14:01:32,234 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:32,234 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:32,234 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:32,239 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38681 2023-02-16 14:01:32,243 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38681 2023-02-16 14:01:32,243 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38681 2023-02-16 14:01:32,244 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38681 2023-02-16 14:01:32,244 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38681 2023-02-16 14:01:32,244 INFO [Listener at localhost.localdomain/40075] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073, hbase.cluster.distributed=false 2023-02-16 14:01:32,255 INFO [Listener at localhost.localdomain/40075] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:32,256 INFO [Listener at localhost.localdomain/40075] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:32,257 INFO [Listener at localhost.localdomain/40075] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45661 2023-02-16 14:01:32,257 INFO [Listener at localhost.localdomain/40075] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:32,257 DEBUG [Listener at localhost.localdomain/40075] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:32,258 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,259 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,259 INFO [Listener at localhost.localdomain/40075] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45661 connecting to ZooKeeper ensemble=127.0.0.1:57880 2023-02-16 14:01:32,261 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:456610x0, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:32,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45661-0x1016b9784c60001 connected 2023-02-16 14:01:32,263 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:32,265 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:32,265 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:32,266 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45661 2023-02-16 14:01:32,266 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45661 2023-02-16 14:01:32,266 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45661 2023-02-16 14:01:32,266 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45661 2023-02-16 14:01:32,266 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45661 2023-02-16 14:01:32,276 INFO [Listener at localhost.localdomain/40075] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-16 14:01:32,276 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,276 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,277 INFO [Listener at localhost.localdomain/40075] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 14:01:32,277 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 14:01:32,277 INFO [Listener at localhost.localdomain/40075] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 14:01:32,277 INFO [Listener at localhost.localdomain/40075] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 14:01:32,278 INFO [Listener at localhost.localdomain/40075] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42753 2023-02-16 14:01:32,278 INFO [Listener at localhost.localdomain/40075] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 14:01:32,279 DEBUG [Listener at localhost.localdomain/40075] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:32,279 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,280 INFO [Listener at localhost.localdomain/40075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,281 INFO [Listener at localhost.localdomain/40075] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42753 connecting to ZooKeeper ensemble=127.0.0.1:57880 2023-02-16 14:01:32,285 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:427530x0, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 14:01:32,285 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:427530x0, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:32,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42753-0x1016b9784c60002 connected 2023-02-16 14:01:32,286 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:32,287 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 14:01:32,288 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42753 2023-02-16 14:01:32,288 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42753 2023-02-16 14:01:32,289 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42753 2023-02-16 14:01:32,289 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42753 2023-02-16 14:01:32,289 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42753 2023-02-16 14:01:32,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,301 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:32,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,302 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:32,302 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:32,302 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:32,305 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,306 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:32,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 14:01:32,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,38681,1676556092210 from backup master directory 2023-02-16 14:01:32,308 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,308 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 14:01:32,308 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:32,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/hbase.id with ID: 4e8e0167-f403-4af4-b373-551d07319394 2023-02-16 14:01:32,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 14:01:32,334 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,341 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5648988f to 127.0.0.1:57880 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:32,351 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fc45adc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:32,351 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:32,352 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 14:01:32,352 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:32,353 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store-tmp 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:32,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:32,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:32,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:32,360 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/WALs/jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,362 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38681%2C1676556092210, suffix=, logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/WALs/jenkins-hbase20.apache.org,38681,1676556092210, archiveDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/oldWALs, maxLogs=10 2023-02-16 14:01:32,377 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK] 2023-02-16 14:01:32,377 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK] 2023-02-16 14:01:32,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/WALs/jenkins-hbase20.apache.org,38681,1676556092210/jenkins-hbase20.apache.org%2C38681%2C1676556092210.1676556092362 2023-02-16 14:01:32,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK], DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK]] 2023-02-16 14:01:32,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:32,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:32,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,380 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,381 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 14:01:32,381 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 14:01:32,382 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,382 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 14:01:32,386 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:32,386 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70213226, jitterRate=0.0462585985660553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:32,386 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:32,386 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 14:01:32,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 14:01:32,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 14:01:32,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 14:01:32,388 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 14:01:32,388 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 14:01:32,388 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 14:01:32,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 14:01:32,389 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 14:01:32,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 14:01:32,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 14:01:32,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 14:01:32,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 14:01:32,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 14:01:32,399 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 14:01:32,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 14:01:32,401 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 14:01:32,401 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:32,401 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:32,401 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,401 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:32,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,38681,1676556092210, sessionid=0x1016b9784c60000, setting cluster-up flag (Was=false) 2023-02-16 14:01:32,404 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,406 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 14:01:32,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,409 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,410 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 14:01:32,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:32,411 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/.tmp 2023-02-16 14:01:32,412 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:32,413 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676556122414 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 14:01:32,415 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:32,415 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 14:01:32,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 14:01:32,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 14:01:32,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 14:01:32,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 14:01:32,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 14:01:32,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556092417,5,FailOnTimeoutGroup] 2023-02-16 14:01:32,417 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:32,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556092417,5,FailOnTimeoutGroup] 2023-02-16 14:01:32,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 14:01:32,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,426 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:32,427 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:32,427 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073 2023-02-16 14:01:32,435 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:32,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:32,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/info 2023-02-16 14:01:32,438 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:32,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:32,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:32,441 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:32,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:32,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/table 2023-02-16 14:01:32,444 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:32,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,445 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740 2023-02-16 14:01:32,446 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740 2023-02-16 14:01:32,448 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:32,449 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:32,452 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:32,453 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71164775, jitterRate=0.06043778359889984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:32,453 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:32,453 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:32,453 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:32,454 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 14:01:32,454 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 14:01:32,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 14:01:32,457 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 14:01:32,459 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 14:01:32,494 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(952): ClusterId : 4e8e0167-f403-4af4-b373-551d07319394 2023-02-16 14:01:32,494 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:32,494 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(952): ClusterId : 4e8e0167-f403-4af4-b373-551d07319394 2023-02-16 14:01:32,495 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 14:01:32,497 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:32,497 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:32,497 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 14:01:32,497 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 14:01:32,498 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:32,499 DEBUG [RS:0;jenkins-hbase20:45661] zookeeper.ReadOnlyZKClient(139): Connect 0x56b9d948 to 127.0.0.1:57880 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:32,499 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 14:01:32,500 DEBUG [RS:1;jenkins-hbase20:42753] zookeeper.ReadOnlyZKClient(139): Connect 0x39399a82 to 127.0.0.1:57880 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:32,502 DEBUG [RS:0;jenkins-hbase20:45661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@587e2def, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:32,502 DEBUG [RS:1;jenkins-hbase20:42753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37fe63d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:32,502 DEBUG [RS:0;jenkins-hbase20:45661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c41b238, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:32,502 DEBUG [RS:1;jenkins-hbase20:42753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33c1f1f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:32,514 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:45661 2023-02-16 14:01:32,514 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:42753 2023-02-16 14:01:32,514 INFO [RS:0;jenkins-hbase20:45661] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:32,514 INFO [RS:0;jenkins-hbase20:45661] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:32,514 INFO [RS:1;jenkins-hbase20:42753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 14:01:32,514 INFO [RS:1;jenkins-hbase20:42753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 14:01:32,514 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:32,514 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 14:01:32,515 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,38681,1676556092210 with isa=jenkins-hbase20.apache.org/148.251.75.209:45661, startcode=1676556092255 2023-02-16 14:01:32,515 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,38681,1676556092210 with isa=jenkins-hbase20.apache.org/148.251.75.209:42753, startcode=1676556092276 2023-02-16 14:01:32,515 DEBUG [RS:0;jenkins-hbase20:45661] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:32,515 DEBUG [RS:1;jenkins-hbase20:42753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 14:01:32,516 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44297, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:32,516 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56677, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 14:01:32,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38681] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,518 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073 2023-02-16 14:01:32,518 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073 2023-02-16 14:01:32,519 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42835 2023-02-16 14:01:32,519 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42835 2023-02-16 14:01:32,519 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:32,519 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 14:01:32,521 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:32,522 DEBUG [RS:0;jenkins-hbase20:45661] zookeeper.ZKUtil(162): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,522 DEBUG [RS:1;jenkins-hbase20:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,522 WARN [RS:0;jenkins-hbase20:45661] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:32,522 WARN [RS:1;jenkins-hbase20:42753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 14:01:32,522 INFO [RS:0;jenkins-hbase20:45661] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:32,522 INFO [RS:1;jenkins-hbase20:42753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:32,522 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,45661,1676556092255] 2023-02-16 14:01:32,522 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,522 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42753,1676556092276] 2023-02-16 14:01:32,522 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,530 DEBUG [RS:1;jenkins-hbase20:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,530 DEBUG [RS:0;jenkins-hbase20:45661] zookeeper.ZKUtil(162): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,530 DEBUG [RS:1;jenkins-hbase20:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,530 DEBUG [RS:0;jenkins-hbase20:45661] zookeeper.ZKUtil(162): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,531 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:32,531 DEBUG [RS:0;jenkins-hbase20:45661] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 14:01:32,531 INFO [RS:1;jenkins-hbase20:42753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:32,531 INFO [RS:0;jenkins-hbase20:45661] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 14:01:32,532 INFO [RS:1;jenkins-hbase20:42753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:32,532 INFO [RS:1;jenkins-hbase20:42753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:32,532 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,533 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:32,535 INFO [RS:0;jenkins-hbase20:45661] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 14:01:32,535 INFO [RS:0;jenkins-hbase20:45661] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 14:01:32,535 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,535 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 14:01:32,536 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,536 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,536 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,536 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,536 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:1;jenkins-hbase20:42753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,537 DEBUG [RS:0;jenkins-hbase20:45661] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-16 14:01:32,539 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,539 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,539 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,539 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,540 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,540 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,549 INFO [RS:0;jenkins-hbase20:45661] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:32,549 INFO [RS:1;jenkins-hbase20:42753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 14:01:32,550 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45661,1676556092255-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,550 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42753,1676556092276-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,559 INFO [RS:0;jenkins-hbase20:45661] regionserver.Replication(203): jenkins-hbase20.apache.org,45661,1676556092255 started 2023-02-16 14:01:32,559 INFO [RS:1;jenkins-hbase20:42753] regionserver.Replication(203): jenkins-hbase20.apache.org,42753,1676556092276 started 2023-02-16 14:01:32,559 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,45661,1676556092255, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:45661, sessionid=0x1016b9784c60001 2023-02-16 14:01:32,559 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42753,1676556092276, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42753, sessionid=0x1016b9784c60002 2023-02-16 14:01:32,559 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45661,1676556092255' 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42753,1676556092276' 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,560 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42753,1676556092276' 2023-02-16 14:01:32,561 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:32,560 DEBUG [RS:0;jenkins-hbase20:45661] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:32,561 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45661,1676556092255' 2023-02-16 14:01:32,561 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:32,561 DEBUG [RS:1;jenkins-hbase20:42753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:32,561 DEBUG [RS:0;jenkins-hbase20:45661] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:32,561 DEBUG [RS:1;jenkins-hbase20:42753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:32,561 DEBUG [RS:0;jenkins-hbase20:45661] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 14:01:32,561 INFO [RS:1;jenkins-hbase20:42753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:32,561 INFO [RS:0;jenkins-hbase20:45661] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 14:01:32,561 INFO [RS:0;jenkins-hbase20:45661] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:32,561 INFO [RS:1;jenkins-hbase20:42753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 14:01:32,609 DEBUG [jenkins-hbase20:38681] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 14:01:32,610 DEBUG [jenkins-hbase20:38681] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:32,612 DEBUG [jenkins-hbase20:38681] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:32,612 DEBUG [jenkins-hbase20:38681] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:32,612 DEBUG [jenkins-hbase20:38681] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:32,612 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42753,1676556092276, state=OPENING 2023-02-16 14:01:32,614 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 14:01:32,615 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:32,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42753,1676556092276}] 2023-02-16 14:01:32,616 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:32,771 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:32,772 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 14:01:32,774 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 14:01:32,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 14:01:32,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 14:01:32,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42753%2C1676556092276.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,42753,1676556092276, archiveDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs, maxLogs=32 2023-02-16 14:01:32,798 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK] 2023-02-16 14:01:32,798 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK] 2023-02-16 14:01:32,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,42753,1676556092276/jenkins-hbase20.apache.org%2C42753%2C1676556092276.meta.1676556092783.meta 2023-02-16 14:01:32,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK], DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK]] 2023-02-16 14:01:32,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:32,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 14:01:32,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 14:01:32,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 14:01:32,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 14:01:32,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:32,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 14:01:32,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 14:01:32,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 14:01:32,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/info 2023-02-16 14:01:32,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/info 2023-02-16 14:01:32,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 14:01:32,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 14:01:32,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:32,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/rep_barrier 2023-02-16 14:01:32,804 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 14:01:32,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 14:01:32,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/table 2023-02-16 14:01:32,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/table 2023-02-16 14:01:32,806 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 14:01:32,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:32,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740 2023-02-16 14:01:32,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740 2023-02-16 14:01:32,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 14:01:32,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 14:01:32,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64952875, jitterRate=-0.032126739621162415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 14:01:32,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 14:01:32,812 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676556092771 2023-02-16 14:01:32,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 14:01:32,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 14:01:32,816 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42753,1676556092276, state=OPEN 2023-02-16 14:01:32,817 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 14:01:32,817 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 14:01:32,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 14:01:32,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42753,1676556092276 in 201 msec 2023-02-16 14:01:32,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 14:01:32,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-16 14:01:32,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-16 14:01:32,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676556092821, completionTime=-1 2023-02-16 14:01:32,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 14:01:32,822 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 14:01:32,825 DEBUG [hconnection-0xd044c69-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:32,826 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:32,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 14:01:32,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676556152827 2023-02-16 14:01:32,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676556212827 2023-02-16 14:01:32,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 14:01:32,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38681,1676556092210-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38681,1676556092210-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38681,1676556092210-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:38681, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 14:01:32,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 14:01:32,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:32,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 14:01:32,842 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 14:01:32,843 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:32,844 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:32,846 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:32,847 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53 empty. 2023-02-16 14:01:32,848 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:32,848 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 14:01:32,857 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:32,857 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ee7d2b037216cb01adbdf5dae3477a53, NAME => 'hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ee7d2b037216cb01adbdf5dae3477a53, disabling compactions & flushes 2023-02-16 14:01:32,867 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. after waiting 0 ms 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:32,867 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:32,867 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ee7d2b037216cb01adbdf5dae3477a53: 2023-02-16 14:01:32,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:32,870 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556092870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556092870"}]},"ts":"1676556092870"} 2023-02-16 14:01:32,871 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:32,872 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:32,872 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556092872"}]},"ts":"1676556092872"} 2023-02-16 14:01:32,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 14:01:32,877 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:32,877 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:32,877 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:32,877 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:32,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee7d2b037216cb01adbdf5dae3477a53, ASSIGN}] 2023-02-16 14:01:32,880 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee7d2b037216cb01adbdf5dae3477a53, ASSIGN 2023-02-16 14:01:32,881 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ee7d2b037216cb01adbdf5dae3477a53, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42753,1676556092276; forceNewPlan=false, retain=false 2023-02-16 14:01:33,031 INFO [jenkins-hbase20:38681] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:33,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee7d2b037216cb01adbdf5dae3477a53, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:33,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556093032"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556093032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556093032"}]},"ts":"1676556093032"} 2023-02-16 14:01:33,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ee7d2b037216cb01adbdf5dae3477a53, server=jenkins-hbase20.apache.org,42753,1676556092276}] 2023-02-16 14:01:33,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:33,193 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42753%2C1676556092276, suffix=, logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,42753,1676556092276, archiveDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs, maxLogs=32 2023-02-16 14:01:33,206 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK] 2023-02-16 14:01:33,206 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK] 2023-02-16 14:01:33,208 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,42753,1676556092276/jenkins-hbase20.apache.org%2C42753%2C1676556092276.1676556093193 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK], DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK]] 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ee7d2b037216cb01adbdf5dae3477a53, NAME => 'hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,209 INFO [StoreOpener-ee7d2b037216cb01adbdf5dae3477a53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,210 DEBUG [StoreOpener-ee7d2b037216cb01adbdf5dae3477a53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/info 2023-02-16 14:01:33,210 DEBUG [StoreOpener-ee7d2b037216cb01adbdf5dae3477a53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/info 2023-02-16 14:01:33,211 INFO [StoreOpener-ee7d2b037216cb01adbdf5dae3477a53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee7d2b037216cb01adbdf5dae3477a53 columnFamilyName info 2023-02-16 14:01:33,211 INFO [StoreOpener-ee7d2b037216cb01adbdf5dae3477a53-1] regionserver.HStore(310): Store=ee7d2b037216cb01adbdf5dae3477a53/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:33,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:33,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:33,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ee7d2b037216cb01adbdf5dae3477a53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64758378, jitterRate=-0.0350249707698822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 14:01:33,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ee7d2b037216cb01adbdf5dae3477a53: 2023-02-16 14:01:33,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53., pid=6, masterSystemTime=1676556093188 2023-02-16 14:01:33,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:33,218 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:33,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee7d2b037216cb01adbdf5dae3477a53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:33,219 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676556093218"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556093218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556093218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556093218"}]},"ts":"1676556093218"} 2023-02-16 14:01:33,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 14:01:33,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ee7d2b037216cb01adbdf5dae3477a53, server=jenkins-hbase20.apache.org,42753,1676556092276 in 185 msec 2023-02-16 14:01:33,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 14:01:33,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ee7d2b037216cb01adbdf5dae3477a53, ASSIGN in 343 msec 2023-02-16 14:01:33,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:33,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556093222"}]},"ts":"1676556093222"} 2023-02-16 14:01:33,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 14:01:33,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:33,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-02-16 14:01:33,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 14:01:33,248 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:33,249 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:33,251 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 14:01:33,259 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:33,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 14:01:33,263 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 14:01:33,276 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 14:01:33,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-02-16 14:01:33,298 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 14:01:33,299 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 14:01:33,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.991sec 2023-02-16 14:01:33,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 14:01:33,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 14:01:33,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 14:01:33,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38681,1676556092210-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 14:01:33,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38681,1676556092210-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 14:01:33,304 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 14:01:33,394 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ReadOnlyZKClient(139): Connect 0x7227f181 to 127.0.0.1:57880 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:33,400 DEBUG [Listener at localhost.localdomain/40075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3562806c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:33,403 DEBUG [hconnection-0x75fe49b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:33,405 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:33,407 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:33,407 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 14:01:33,409 DEBUG [Listener at localhost.localdomain/40075] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 14:01:33,411 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 14:01:33,411 INFO [Listener at localhost.localdomain/40075] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 14:01:33,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-16 14:01:33,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 14:01:33,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 148.251.75.209:49840 deadline: 1676556153412, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 14:01:33,413 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 14:01:33,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 14:01:33,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 14:01:33,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 14:01:33,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 14:01:33,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 14:01:33,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:33,421 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 empty. 2023-02-16 14:01:33,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,422 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 14:01:33,437 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 14:01:33,438 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cfc387c416e8a565382482f0d6548903, NAME => 'testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cfc387c416e8a565382482f0d6548903, disabling compactions & flushes 2023-02-16 14:01:33,453 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. after waiting 0 ms 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,453 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,453 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:33,455 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 14:01:33,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676556093456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556093456"}]},"ts":"1676556093456"} 2023-02-16 14:01:33,457 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 14:01:33,458 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 14:01:33,458 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556093458"}]},"ts":"1676556093458"} 2023-02-16 14:01:33,459 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 14:01:33,460 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-16 14:01:33,461 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 14:01:33,461 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 14:01:33,461 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 14:01:33,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, ASSIGN}] 2023-02-16 14:01:33,466 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, ASSIGN 2023-02-16 14:01:33,467 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42753,1676556092276; forceNewPlan=false, retain=false 2023-02-16 14:01:33,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:33,564 INFO [RS:0;jenkins-hbase20:45661] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45661%2C1676556092255, suffix=, logDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,45661,1676556092255, archiveDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs, maxLogs=32 2023-02-16 14:01:33,585 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK] 2023-02-16 14:01:33,585 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK] 2023-02-16 14:01:33,586 INFO [RS:0;jenkins-hbase20:45661] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/WALs/jenkins-hbase20.apache.org,45661,1676556092255/jenkins-hbase20.apache.org%2C45661%2C1676556092255.1676556093565 2023-02-16 14:01:33,586 DEBUG [RS:0;jenkins-hbase20:45661] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-019d168e-5697-4336-a50d-7a8edb3fea5c,DISK], DatanodeInfoWithStorage[127.0.0.1:34557,DS-43159b01-c78e-4d07-a89d-1e04b0fa9e3f,DISK]] 2023-02-16 14:01:33,617 INFO [jenkins-hbase20:38681] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 14:01:33,618 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cfc387c416e8a565382482f0d6548903, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:33,618 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676556093617"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556093617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556093617"}]},"ts":"1676556093617"} 2023-02-16 14:01:33,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure cfc387c416e8a565382482f0d6548903, server=jenkins-hbase20.apache.org,42753,1676556092276}] 2023-02-16 14:01:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:33,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cfc387c416e8a565382482f0d6548903, NAME => 'testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.', STARTKEY => '', ENDKEY => ''} 2023-02-16 14:01:33,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:33,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,780 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,782 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1 2023-02-16 14:01:33,782 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1 2023-02-16 14:01:33,783 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc387c416e8a565382482f0d6548903 columnFamilyName f1 2023-02-16 14:01:33,783 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(310): Store=cfc387c416e8a565382482f0d6548903/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:33,784 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,786 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2 2023-02-16 14:01:33,786 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2 2023-02-16 14:01:33,786 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc387c416e8a565382482f0d6548903 columnFamilyName f2 2023-02-16 14:01:33,787 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(310): Store=cfc387c416e8a565382482f0d6548903/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:33,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:33,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 14:01:33,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened cfc387c416e8a565382482f0d6548903; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70678443, jitterRate=0.05319087207317352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:33,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:33,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903., pid=12, masterSystemTime=1676556093771 2023-02-16 14:01:33,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:33,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cfc387c416e8a565382482f0d6548903, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:33,796 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676556093796"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676556093796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676556093796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676556093796"}]},"ts":"1676556093796"} 2023-02-16 14:01:33,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 14:01:33,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure cfc387c416e8a565382482f0d6548903, server=jenkins-hbase20.apache.org,42753,1676556092276 in 178 msec 2023-02-16 14:01:33,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 14:01:33,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, ASSIGN in 337 msec 2023-02-16 14:01:33,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 14:01:33,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556093801"}]},"ts":"1676556093801"} 2023-02-16 14:01:33,802 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 14:01:33,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 14:01:33,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 389 msec 2023-02-16 14:01:34,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 14:01:34,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 14:01:34,027 INFO [Listener at localhost.localdomain/40075] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 14:01:34,028 DEBUG [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 14:01:34,028 INFO [Listener at localhost.localdomain/40075] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:34,031 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 14:01:34,031 INFO [Listener at localhost.localdomain/40075] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 14:01:34,031 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 14:01:34,031 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 14:01:34,070 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,185 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 14:01:34,185 INFO [Listener at localhost.localdomain/40075] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 14:01:34,186 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:34,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676556094186 (current time:1676556094186). 2023-02-16 14:01:34,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 14:01:34,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] zookeeper.ReadOnlyZKClient(139): Connect 0x64b161e5 to 127.0.0.1:57880 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 14:01:34,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17a006a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 14:01:34,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 14:01:34,192 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 14:01:34,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64b161e5 to 127.0.0.1:57880 2023-02-16 14:01:34,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:34,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 14:01:34,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:34,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:34,197 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:34,197 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676556694197 2023-02-16 14:01:34,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 14:01:34,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 14:01:34,199 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:34,199 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 14:01:34,199 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 14:01:34,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:34,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-16 14:01:34,201 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:34,202 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676556694202 2023-02-16 14:01:34,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-16 14:01:34,211 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-16 14:01:34,211 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:34,212 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-16 14:01:34,212 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 14:01:34,212 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,212 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,213 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:34,213 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:34,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:34,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:34,213 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,214 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 14:01:34,214 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 14:01:34,214 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:34,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45661,1676556092255' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 14:01:34,217 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 14:01:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42753,1676556092276' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 14:01:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,219 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,219 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,219 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,219 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:34,219 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,219 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42753,1676556092276' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-16 14:01:34,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@372a62ef[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:34,220 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 14:01:34,220 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,221 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:34,221 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,221 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:34,221 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 14:01:34,221 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 14:01:34,221 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,45661,1676556092255' in zk 2023-02-16 14:01:34,222 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:34,222 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,222 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 14:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 14:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 14:01:34,223 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,223 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. started... 2023-02-16 14:01:34,223 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cfc387c416e8a565382482f0d6548903 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 14:01:34,250 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f1/34eab250975b45f088b5f15e12324806 2023-02-16 14:01:34,270 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f2/cd6837b3bc0e4bd6899d469e450a3d51 2023-02-16 14:01:34,274 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f1/34eab250975b45f088b5f15e12324806 as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806 2023-02-16 14:01:34,278 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:34,278 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f2/cd6837b3bc0e4bd6899d469e450a3d51 as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51 2023-02-16 14:01:34,283 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 14:01:34,283 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for cfc387c416e8a565382482f0d6548903 in 60ms, sequenceid=5, compaction requested=false 2023-02-16 14:01:34,283 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806] hfiles 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806 for snapshot=testWithMapReduceSingleRegion 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51] hfiles 2023-02-16 14:01:34,284 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51 for snapshot=testWithMapReduceSingleRegion 2023-02-16 14:01:34,293 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. completed. 2023-02-16 14:01:34,293 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,293 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 14:01:34,293 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 14:01:34,293 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,293 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 14:01:34,293 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,42753,1676556092276' in zk 2023-02-16 14:01:34,294 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 14:01:34,294 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,294 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:34,294 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 14:01:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,42753,1676556092276': 2023-02-16 14:01:34,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42753,1676556092276' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 14:01:34,296 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-16 14:01:34,297 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:34,297 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:34,297 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-16 14:01:34,297 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 14:01:34,297 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 14:01:34,297 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,299 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,299 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:34,300 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,300 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 14:01:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 14:01:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,300 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 14:01:34,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 14:01:34,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:34,303 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 14:01:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:34,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 14:01:34,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 14:01:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 14:01:34,303 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 14:01:34,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 14:01:34,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-16 14:01:34,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-16 14:01:34,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 14:01:34,389 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 14:01:34,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676556094198Consolidate snapshot: testWithMapReduceSingleRegion at 1676556094303 (+105 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676556094303Writing data manifest for testWithMapReduceSingleRegion at 1676556094306 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676556094312 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676556094388 (+76 ms) 2023-02-16 14:01:34,391 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 14:01:34,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 192 msec 2023-02-16 14:01:34,501 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 14:01:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 14:01:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 14:01:34,502 INFO [Listener at localhost.localdomain/40075] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 14:01:34,507 INFO [Listener at localhost.localdomain/40075] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 14:01:34,515 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 14:01:34,548 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,628 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 14:01:34,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-16 14:01:34,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 14:01:34,636 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 14:01:34,636 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:34,636 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 14:01:34,636 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 14:01:34,636 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,636 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,637 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:34,637 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:34,637 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:34,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:34,637 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,637 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 14:01:34,638 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 14:01:34,638 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. started... 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:01:34,638 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45661,1676556092255' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:01:34,638 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cfc387c416e8a565382482f0d6548903 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 14:01:34,639 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,639 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,639 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:34,654 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f1/cc39edac114e4b05a16edd9f8c88fe5c 2023-02-16 14:01:34,670 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f2/9e17fde673c146a6a86d9721e90ee4d0 2023-02-16 14:01:34,674 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f1/cc39edac114e4b05a16edd9f8c88fe5c as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/cc39edac114e4b05a16edd9f8c88fe5c 2023-02-16 14:01:34,677 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/cc39edac114e4b05a16edd9f8c88fe5c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:34,678 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/.tmp/f2/9e17fde673c146a6a86d9721e90ee4d0 as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/9e17fde673c146a6a86d9721e90ee4d0 2023-02-16 14:01:34,681 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/9e17fde673c146a6a86d9721e90ee4d0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 14:01:34,682 INFO [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for cfc387c416e8a565382482f0d6548903 in 44ms, sequenceid=9, compaction requested=false 2023-02-16 14:01:34,682 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:34,682 DEBUG [rs(jenkins-hbase20.apache.org,42753,1676556092276)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,682 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 14:01:34,682 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 14:01:34,682 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,682 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 14:01:34,682 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42753,1676556092276' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 14:01:34,683 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,683 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:34,683 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,683 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42753,1676556092276' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 14:01:34,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315e0d2[Count = 0] remaining members to acquire global barrier 2023-02-16 14:01:34,685 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 14:01:34,685 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 14:01:34,686 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,686 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,42753,1676556092276' in zk 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,45661,1676556092255' in zk 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 14:01:34,686 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,686 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,687 DEBUG [member: 'jenkins-hbase20.apache.org,42753,1676556092276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:34,687 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,687 DEBUG [member: 'jenkins-hbase20.apache.org,45661,1676556092255' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,42753,1676556092276': 2023-02-16 14:01:34,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42753,1676556092276' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 14:01:34,689 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 14:01:34,689 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 14:01:34,689 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 14:01:34,689 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 14:01:34,689 INFO [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 14:01:34,690 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 14:01:34,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:34,690 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:34,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 14:01:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,690 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:34,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,691 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,692 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 14:01:34,692 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 14:01:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:34,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 14:01:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:34,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 14:01:34,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 14:01:34,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 14:01:34,694 DEBUG [(jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:34,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 14:01:34,694 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 14:01:34,695 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 14:01:34,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 14:01:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 14:01:34,795 DEBUG [Listener at localhost.localdomain/40075] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 14:01:34,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 14:01:34,879 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/hadoop-7962984301605249109.jar 2023-02-16 14:01:34,882 INFO [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676556094186 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:34,883 DEBUG [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d/data/default/testWithMapReduce 2023-02-16 14:01:34,883 INFO [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(239): region to add: cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:34,883 INFO [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(585): clone region=cfc387c416e8a565382482f0d6548903 as cfc387c416e8a565382482f0d6548903 in snapshot testWithMapReduceSingleRegion 2023-02-16 14:01:34,884 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cfc387c416e8a565382482f0d6548903, NAME => 'testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d 2023-02-16 14:01:34,890 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:34,890 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34eab250975b45f088b5f15e12324806 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 14:01:34,892 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cd6837b3bc0e4bd6899d469e450a3d51 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 14:01:34,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cfc387c416e8a565382482f0d6548903, disabling compactions & flushes 2023-02-16 14:01:34,894 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. after waiting 0 ms 2023-02-16 14:01:34,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,894 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:34,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:34,894 INFO [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676556094186 type: FLUSH version: 2 ttl: 0 2023-02-16 14:01:34,894 DEBUG [Listener at localhost.localdomain/40075] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d 2023-02-16 14:01:34,895 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d 2023-02-16 14:01:34,895 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |-data/ 2023-02-16 14:01:34,895 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |----default/ 2023-02-16 14:01:34,896 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 14:01:34,896 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |----------cfc387c416e8a565382482f0d6548903/ 2023-02-16 14:01:34,897 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 14:01:34,897 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 14:01:34,897 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(702): |----------------testWithMapReduce=cfc387c416e8a565382482f0d6548903-34eab250975b45f088b5f15e12324806 2023-02-16 14:01:34,897 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 14:01:34,898 DEBUG [Listener at localhost.localdomain/40075] util.CommonFSUtils(702): |----------------testWithMapReduce=cfc387c416e8a565382482f0d6548903-cd6837b3bc0e4bd6899d469e450a3d51 2023-02-16 14:01:34,898 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,899 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,899 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,899 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,900 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,900 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,900 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,974 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/hadoop-5954582997609549105.jar 2023-02-16 14:01:34,975 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,975 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,976 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,977 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,977 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,978 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,978 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 14:01:34,979 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 14:01:34,979 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 14:01:34,980 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 14:01:34,980 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 14:01:34,981 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 14:01:34,981 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 14:01:34,982 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 14:01:34,982 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 14:01:34,983 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 14:01:34,984 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 14:01:34,984 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:34,984 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:34,985 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 14:01:34,985 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:01:35,071 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/hadoop-4242763267447545697.jar 2023-02-16 14:01:35,071 DEBUG [Listener at localhost.localdomain/40075] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 14:01:35,076 WARN [Listener at localhost.localdomain/40075] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 14:01:35,104 INFO [Listener at localhost.localdomain/40075] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 14:01:35,168 WARN [Listener at localhost.localdomain/40075] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/mapreduce.cluster.local.dir/1676556095136/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 14:01:35,169 WARN [Listener at localhost.localdomain/40075] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/mapreduce.cluster.local.dir/1676556095136/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 14:01:35,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 14:01:35,213 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 14:01:35,214 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 14:01:35,216 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:35,217 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1 2023-02-16 14:01:35,218 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc387c416e8a565382482f0d6548903 columnFamilyName f1 2023-02-16 14:01:35,227 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/testWithMapReduce=cfc387c416e8a565382482f0d6548903-34eab250975b45f088b5f15e12324806 2023-02-16 14:01:35,227 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(310): Store=cfc387c416e8a565382482f0d6548903/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:35,227 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:35,228 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2 2023-02-16 14:01:35,229 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc387c416e8a565382482f0d6548903 columnFamilyName f2 2023-02-16 14:01:35,233 DEBUG [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42835/user/jenkins/test-data/fedcb209-26cf-b3be-7d02-c505dec6f92f/testWithMapReduceSingleRegion/951739b0-d2be-422b-a217-39014142b42d/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/testWithMapReduce=cfc387c416e8a565382482f0d6548903-cd6837b3bc0e4bd6899d469e450a3d51 2023-02-16 14:01:35,233 INFO [StoreOpener-cfc387c416e8a565382482f0d6548903-1] regionserver.HStore(310): Store=cfc387c416e8a565382482f0d6548903/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 14:01:35,234 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 14:01:35,234 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cfc387c416e8a565382482f0d6548903; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65282336, jitterRate=-0.027217388153076172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 14:01:35,234 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:35,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cfc387c416e8a565382482f0d6548903, disabling compactions & flushes 2023-02-16 14:01:35,311 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:35,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:35,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. after waiting 0 ms 2023-02-16 14:01:35,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:35,313 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:35,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:36,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceSingleRegion" 2023-02-16 14:01:36,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-16 14:01:36,224 INFO [Listener at localhost.localdomain/40075] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 14:01:36,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-16 14:01:36,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,228 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556096228"}]},"ts":"1676556096228"} 2023-02-16 14:01:36,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:36,229 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 14:01:36,230 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 14:01:36,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, UNASSIGN}] 2023-02-16 14:01:36,231 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, UNASSIGN 2023-02-16 14:01:36,232 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cfc387c416e8a565382482f0d6548903, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:36,232 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676556096232"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676556096232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676556096232"}]},"ts":"1676556096232"} 2023-02-16 14:01:36,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure cfc387c416e8a565382482f0d6548903, server=jenkins-hbase20.apache.org,42753,1676556092276}] 2023-02-16 14:01:36,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:36,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:36,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing cfc387c416e8a565382482f0d6548903, disabling compactions & flushes 2023-02-16 14:01:36,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:36,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:36,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. after waiting 0 ms 2023-02-16 14:01:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 14:01:36,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903. 2023-02-16 14:01:36,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for cfc387c416e8a565382482f0d6548903: 2023-02-16 14:01:36,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:36,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cfc387c416e8a565382482f0d6548903, regionState=CLOSED 2023-02-16 14:01:36,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676556096400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676556096400"}]},"ts":"1676556096400"} 2023-02-16 14:01:36,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 14:01:36,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure cfc387c416e8a565382482f0d6548903, server=jenkins-hbase20.apache.org,42753,1676556092276 in 170 msec 2023-02-16 14:01:36,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 14:01:36,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cfc387c416e8a565382482f0d6548903, UNASSIGN in 174 msec 2023-02-16 14:01:36,409 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676556096408"}]},"ts":"1676556096408"} 2023-02-16 14:01:36,414 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 14:01:36,415 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 14:01:36,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 191 msec 2023-02-16 14:01:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 14:01:36,531 INFO [Listener at localhost.localdomain/40075] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-16 14:01:36,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-16 14:01:36,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:36,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:36,541 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1, FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2, FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/recovered.edits] 2023-02-16 14:01:36,544 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806 to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/archive/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/34eab250975b45f088b5f15e12324806 2023-02-16 14:01:36,546 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/cc39edac114e4b05a16edd9f8c88fe5c to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/archive/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f1/cc39edac114e4b05a16edd9f8c88fe5c 2023-02-16 14:01:36,548 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/9e17fde673c146a6a86d9721e90ee4d0 to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/archive/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/9e17fde673c146a6a86d9721e90ee4d0 2023-02-16 14:01:36,550 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51 to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/archive/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/f2/cd6837b3bc0e4bd6899d469e450a3d51 2023-02-16 14:01:36,552 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/recovered.edits/12.seqid to hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/archive/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903/recovered.edits/12.seqid 2023-02-16 14:01:36,553 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/.tmp/data/default/testWithMapReduce/cfc387c416e8a565382482f0d6548903 2023-02-16 14:01:36,553 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 14:01:36,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,556 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-16 14:01:36,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 14:01:36,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,559 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 14:01:36,559 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676556096559"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:36,560 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 14:01:36,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cfc387c416e8a565382482f0d6548903, NAME => 'testWithMapReduce,,1676556093416.cfc387c416e8a565382482f0d6548903.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 14:01:36,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 14:01:36,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676556096561"}]},"ts":"9223372036854775807"} 2023-02-16 14:01:36,562 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 14:01:36,563 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 14:01:36,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 31 msec 2023-02-16 14:01:36,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38681] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 14:01:36,640 INFO [Listener at localhost.localdomain/40075] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-16 14:01:36,640 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 14:01:36,640 INFO [Listener at localhost.localdomain/40075] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 14:01:36,641 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7227f181 to 127.0.0.1:57880 2023-02-16 14:01:36,641 DEBUG [Listener at localhost.localdomain/40075] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:36,642 DEBUG [Listener at localhost.localdomain/40075] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 14:01:36,642 DEBUG [Listener at localhost.localdomain/40075] util.JVMClusterUtil(257): Found active master hash=2086207800, stopped=false 2023-02-16 14:01:36,642 INFO [Listener at localhost.localdomain/40075] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:36,644 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:36,644 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:36,644 INFO [Listener at localhost.localdomain/40075] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 14:01:36,644 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 14:01:36,644 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:36,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:36,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:36,647 DEBUG [Listener at localhost.localdomain/40075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5648988f to 127.0.0.1:57880 2023-02-16 14:01:36,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 14:01:36,647 DEBUG [Listener at localhost.localdomain/40075] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:36,648 INFO [Listener at localhost.localdomain/40075] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,45661,1676556092255' ***** 2023-02-16 14:01:36,648 INFO [Listener at localhost.localdomain/40075] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:36,648 INFO [Listener at localhost.localdomain/40075] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42753,1676556092276' ***** 2023-02-16 14:01:36,648 INFO [Listener at localhost.localdomain/40075] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 14:01:36,648 INFO [RS:0;jenkins-hbase20:45661] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:36,648 INFO [RS:1;jenkins-hbase20:42753] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 14:01:36,648 INFO [RS:0;jenkins-hbase20:45661] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:36,648 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:36,648 INFO [RS:0;jenkins-hbase20:45661] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:36,648 INFO [RS:1;jenkins-hbase20:42753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 14:01:36,648 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 14:01:36,648 INFO [RS:1;jenkins-hbase20:42753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 14:01:36,648 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:36,649 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(3304): Received CLOSE for ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:36,649 DEBUG [RS:0;jenkins-hbase20:45661] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56b9d948 to 127.0.0.1:57880 2023-02-16 14:01:36,649 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:36,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ee7d2b037216cb01adbdf5dae3477a53, disabling compactions & flushes 2023-02-16 14:01:36,649 DEBUG [RS:0;jenkins-hbase20:45661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:36,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:36,649 DEBUG [RS:1;jenkins-hbase20:42753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39399a82 to 127.0.0.1:57880 2023-02-16 14:01:36,649 DEBUG [RS:1;jenkins-hbase20:42753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:36,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:36,649 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,45661,1676556092255; all regions closed. 2023-02-16 14:01:36,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. after waiting 0 ms 2023-02-16 14:01:36,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:36,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing ee7d2b037216cb01adbdf5dae3477a53 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 14:01:36,649 INFO [RS:1;jenkins-hbase20:42753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:36,650 INFO [RS:1;jenkins-hbase20:42753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:36,650 INFO [RS:1;jenkins-hbase20:42753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:36,650 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 14:01:36,650 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 14:01:36,650 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1479): Online Regions={ee7d2b037216cb01adbdf5dae3477a53=hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 14:01:36,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 14:01:36,650 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1505): Waiting on 1588230740, ee7d2b037216cb01adbdf5dae3477a53 2023-02-16 14:01:36,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 14:01:36,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 14:01:36,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 14:01:36,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 14:01:36,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.71 KB heapSize=7.12 KB 2023-02-16 14:01:36,656 DEBUG [RS:0;jenkins-hbase20:45661] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs 2023-02-16 14:01:36,656 INFO [RS:0;jenkins-hbase20:45661] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C45661%2C1676556092255:(num 1676556093565) 2023-02-16 14:01:36,656 DEBUG [RS:0;jenkins-hbase20:45661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:36,656 INFO [RS:0;jenkins-hbase20:45661] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:36,657 INFO [RS:0;jenkins-hbase20:45661] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:36,657 INFO [RS:0;jenkins-hbase20:45661] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 14:01:36,657 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:36,657 INFO [RS:0;jenkins-hbase20:45661] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 14:01:36,657 INFO [RS:0;jenkins-hbase20:45661] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 14:01:36,658 INFO [RS:0;jenkins-hbase20:45661] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45661 2023-02-16 14:01:36,659 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:36,659 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:36,659 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45661,1676556092255 2023-02-16 14:01:36,659 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:36,659 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:36,662 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,45661,1676556092255] 2023-02-16 14:01:36,662 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,45661,1676556092255; numProcessing=1 2023-02-16 14:01:36,663 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,45661,1676556092255 already deleted, retry=false 2023-02-16 14:01:36,663 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,45661,1676556092255 expired; onlineServers=1 2023-02-16 14:01:36,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/.tmp/info/5b9f853a4fd44910a95eb881bd5fa644 2023-02-16 14:01:36,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/.tmp/info/5b9f853a4fd44910a95eb881bd5fa644 as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/info/5b9f853a4fd44910a95eb881bd5fa644 2023-02-16 14:01:36,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/info/5b9f853a4fd44910a95eb881bd5fa644, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 14:01:36,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ee7d2b037216cb01adbdf5dae3477a53 in 21ms, sequenceid=6, compaction requested=false 2023-02-16 14:01:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/namespace/ee7d2b037216cb01adbdf5dae3477a53/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 14:01:36,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:36,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ee7d2b037216cb01adbdf5dae3477a53: 2023-02-16 14:01:36,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676556092838.ee7d2b037216cb01adbdf5dae3477a53. 2023-02-16 14:01:36,676 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:36,677 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:36,844 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:36,844 INFO [RS:0;jenkins-hbase20:45661] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,45661,1676556092255; zookeeper connection closed. 2023-02-16 14:01:36,844 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7244f227 rejected from java.util.concurrent.ThreadPoolExecutor@767b68b7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:36,844 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3cc99332] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3cc99332 2023-02-16 14:01:36,844 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:45661-0x1016b9784c60001, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:36,844 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5780488f rejected from java.util.concurrent.ThreadPoolExecutor@767b68b7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:36,850 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:36,850 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 14:01:36,851 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 14:01:37,051 DEBUG [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 14:01:37,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/info/86537c81508541afa16a213405df9185 2023-02-16 14:01:37,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86537c81508541afa16a213405df9185 2023-02-16 14:01:37,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/rep_barrier/b427ea8c78c74b36bbc1112e9eab4b5b 2023-02-16 14:01:37,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b427ea8c78c74b36bbc1112e9eab4b5b 2023-02-16 14:01:37,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/table/da2b53a99efd4a158c31b251e6741ebd 2023-02-16 14:01:37,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da2b53a99efd4a158c31b251e6741ebd 2023-02-16 14:01:37,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/info/86537c81508541afa16a213405df9185 as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/info/86537c81508541afa16a213405df9185 2023-02-16 14:01:37,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86537c81508541afa16a213405df9185 2023-02-16 14:01:37,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/info/86537c81508541afa16a213405df9185, entries=12, sequenceid=21, filesize=6.2 K 2023-02-16 14:01:37,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/rep_barrier/b427ea8c78c74b36bbc1112e9eab4b5b as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/rep_barrier/b427ea8c78c74b36bbc1112e9eab4b5b 2023-02-16 14:01:37,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b427ea8c78c74b36bbc1112e9eab4b5b 2023-02-16 14:01:37,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/rep_barrier/b427ea8c78c74b36bbc1112e9eab4b5b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 14:01:37,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/.tmp/table/da2b53a99efd4a158c31b251e6741ebd as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/table/da2b53a99efd4a158c31b251e6741ebd 2023-02-16 14:01:37,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da2b53a99efd4a158c31b251e6741ebd 2023-02-16 14:01:37,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/table/da2b53a99efd4a158c31b251e6741ebd, entries=4, sequenceid=21, filesize=5.0 K 2023-02-16 14:01:37,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.71 KB/3794, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 461ms, sequenceid=21, compaction requested=false 2023-02-16 14:01:37,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 14:01:37,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 14:01:37,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:37,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 14:01:37,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 14:01:37,251 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42753,1676556092276; all regions closed. 2023-02-16 14:01:37,261 DEBUG [RS:1;jenkins-hbase20:42753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs 2023-02-16 14:01:37,261 INFO [RS:1;jenkins-hbase20:42753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42753%2C1676556092276.meta:.meta(num 1676556092783) 2023-02-16 14:01:37,267 DEBUG [RS:1;jenkins-hbase20:42753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/oldWALs 2023-02-16 14:01:37,267 INFO [RS:1;jenkins-hbase20:42753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42753%2C1676556092276:(num 1676556093193) 2023-02-16 14:01:37,267 DEBUG [RS:1;jenkins-hbase20:42753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:37,267 INFO [RS:1;jenkins-hbase20:42753] regionserver.LeaseManager(133): Closed leases 2023-02-16 14:01:37,267 INFO [RS:1;jenkins-hbase20:42753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 14:01:37,267 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:37,269 INFO [RS:1;jenkins-hbase20:42753] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42753 2023-02-16 14:01:37,270 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 14:01:37,270 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42753,1676556092276 2023-02-16 14:01:37,270 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42753,1676556092276] 2023-02-16 14:01:37,270 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42753,1676556092276; numProcessing=2 2023-02-16 14:01:37,271 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42753,1676556092276 already deleted, retry=false 2023-02-16 14:01:37,271 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42753,1676556092276 expired; onlineServers=0 2023-02-16 14:01:37,271 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,38681,1676556092210' ***** 2023-02-16 14:01:37,271 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 14:01:37,272 DEBUG [M:0;jenkins-hbase20:38681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78668a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-16 14:01:37,272 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,38681,1676556092210 2023-02-16 14:01:37,272 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,38681,1676556092210; all regions closed. 2023-02-16 14:01:37,272 DEBUG [M:0;jenkins-hbase20:38681] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 14:01:37,272 DEBUG [M:0;jenkins-hbase20:38681] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 14:01:37,272 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 14:01:37,272 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556092417] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676556092417,5,FailOnTimeoutGroup] 2023-02-16 14:01:37,272 DEBUG [M:0;jenkins-hbase20:38681] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 14:01:37,272 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556092417] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676556092417,5,FailOnTimeoutGroup] 2023-02-16 14:01:37,273 INFO [M:0;jenkins-hbase20:38681] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 14:01:37,273 INFO [M:0;jenkins-hbase20:38681] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 14:01:37,273 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 14:01:37,273 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 14:01:37,273 INFO [M:0;jenkins-hbase20:38681] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-16 14:01:37,273 DEBUG [M:0;jenkins-hbase20:38681] master.HMaster(1512): Stopping service threads 2023-02-16 14:01:37,273 INFO [M:0;jenkins-hbase20:38681] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 14:01:37,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 14:01:37,274 ERROR [M:0;jenkins-hbase20:38681] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 14:01:37,274 INFO [M:0;jenkins-hbase20:38681] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 14:01:37,274 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 14:01:37,274 DEBUG [M:0;jenkins-hbase20:38681] zookeeper.ZKUtil(398): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 14:01:37,274 WARN [M:0;jenkins-hbase20:38681] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 14:01:37,274 INFO [M:0;jenkins-hbase20:38681] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 14:01:37,275 INFO [M:0;jenkins-hbase20:38681] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 14:01:37,275 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 14:01:37,275 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:37,275 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:37,275 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 14:01:37,275 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:37,275 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.73 KB heapSize=65.70 KB 2023-02-16 14:01:37,285 INFO [M:0;jenkins-hbase20:38681] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.73 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8c558823605c499bab842f3fa73a7bec 2023-02-16 14:01:37,289 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8c558823605c499bab842f3fa73a7bec as hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8c558823605c499bab842f3fa73a7bec 2023-02-16 14:01:37,292 INFO [M:0;jenkins-hbase20:38681] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42835/user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8c558823605c499bab842f3fa73a7bec, entries=17, sequenceid=132, filesize=8.6 K 2023-02-16 14:01:37,293 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegion(2947): Finished flush of dataSize ~54.73 KB/56041, heapSize ~65.68 KB/67256, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-16 14:01:37,293 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 14:01:37,293 DEBUG [M:0;jenkins-hbase20:38681] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 14:01:37,295 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a5629025-e572-b911-847b-7abe1a29c073/MasterData/WALs/jenkins-hbase20.apache.org,38681,1676556092210/jenkins-hbase20.apache.org%2C38681%2C1676556092210.1676556092362 not finished, retry = 0 2023-02-16 14:01:37,371 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:37,371 INFO [RS:1;jenkins-hbase20:42753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42753,1676556092276; zookeeper connection closed. 2023-02-16 14:01:37,371 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e9c1192 rejected from java.util.concurrent.ThreadPoolExecutor@3aa38299[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:37,372 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1016b9784c60002, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:37,372 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@105ab115 rejected from java.util.concurrent.ThreadPoolExecutor@3aa38299[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:37,372 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d1d387e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d1d387e 2023-02-16 14:01:37,372 INFO [Listener at localhost.localdomain/40075] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 14:01:37,397 INFO [M:0;jenkins-hbase20:38681] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 14:01:37,397 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 14:01:37,397 INFO [M:0;jenkins-hbase20:38681] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38681 2023-02-16 14:01:37,399 DEBUG [M:0;jenkins-hbase20:38681] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,38681,1676556092210 already deleted, retry=false 2023-02-16 14:01:37,502 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:37,502 INFO [M:0;jenkins-hbase20:38681] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,38681,1676556092210; zookeeper connection closed. 2023-02-16 14:01:37,502 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a453c66 rejected from java.util.concurrent.ThreadPoolExecutor@5e7ab3f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:37,505 DEBUG [Listener at localhost.localdomain/40075-EventThread] zookeeper.ZKWatcher(600): master:38681-0x1016b9784c60000, quorum=127.0.0.1:57880, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 14:01:37,505 WARN [Listener at localhost.localdomain/40075] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:37,505 ERROR [Listener at localhost.localdomain/40075-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59fc9b5c rejected from java.util.concurrent.ThreadPoolExecutor@5e7ab3f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 14:01:37,513 INFO [Listener at localhost.localdomain/40075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:37,615 WARN [BP-546976643-148.251.75.209-1676556091659 heartbeating to localhost.localdomain/127.0.0.1:42835] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:37,615 WARN [BP-546976643-148.251.75.209-1676556091659 heartbeating to localhost.localdomain/127.0.0.1:42835] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-546976643-148.251.75.209-1676556091659 (Datanode Uuid 30dc5c74-a980-482b-bb23-6bea22900e2a) service to localhost.localdomain/127.0.0.1:42835 2023-02-16 14:01:37,617 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/dfs/data/data3/current/BP-546976643-148.251.75.209-1676556091659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:37,618 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/dfs/data/data4/current/BP-546976643-148.251.75.209-1676556091659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:37,622 WARN [Listener at localhost.localdomain/40075] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 14:01:37,626 INFO [Listener at localhost.localdomain/40075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 14:01:37,727 WARN [BP-546976643-148.251.75.209-1676556091659 heartbeating to localhost.localdomain/127.0.0.1:42835] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 14:01:37,727 WARN [BP-546976643-148.251.75.209-1676556091659 heartbeating to localhost.localdomain/127.0.0.1:42835] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-546976643-148.251.75.209-1676556091659 (Datanode Uuid 52ab66d3-c8b1-4c40-b409-c4d6c8e144fd) service to localhost.localdomain/127.0.0.1:42835 2023-02-16 14:01:37,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/dfs/data/data1/current/BP-546976643-148.251.75.209-1676556091659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:37,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/95d79be6-47a3-51e2-70a3-834066c56fd8/cluster_25ecc189-4b87-c2c0-0bdb-3b3f1e1aca5d/dfs/data/data2/current/BP-546976643-148.251.75.209-1676556091659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 14:01:37,741 INFO [Listener at localhost.localdomain/40075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-16 14:01:37,860 INFO [Listener at localhost.localdomain/40075] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 14:01:37,885 INFO [Listener at localhost.localdomain/40075] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 14:01:37,899 INFO [Listener at localhost.localdomain/40075] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=290 (was 270) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:42835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/40075 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:42835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:42835 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:42835 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (390351940) connection to localhost.localdomain/127.0.0.1:42835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost.localdomain:42835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,38681,1676556092210)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost.localdomain:42835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=591 (was 566) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 250) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=2535 (was 2669)