2023-02-09 06:02:45,581 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-09 06:02:45,625 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=166, AvailableMemoryMB=4952 2023-02-09 06:02:45,893 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68 2023-02-09 06:02:45,900 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:02:45,901 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea, deleteOnExit=true 2023-02-09 06:02:45,901 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:02:45,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/test.cache.data in system properties and HBase conf 2023-02-09 06:02:45,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:02:45,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:02:45,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:02:45,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:02:45,905 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:02:46,081 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 06:02:46,445 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:02:46,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:02:46,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:02:46,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:02:46,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:02:46,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:02:46,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:02:46,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:02:46,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:02:46,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:02:46,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:02:46,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:02:46,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:02:46,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:02:46,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:02:46,933 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:02:46,937 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:02:47,201 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 06:02:47,348 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 06:02:47,361 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:02:47,398 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:02:47,432 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/java.io.tmpdir/Jetty_localhost_41385_hdfs____.4tz98j/webapp 2023-02-09 06:02:47,576 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41385 2023-02-09 06:02:47,589 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:02:47,589 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:02:48,091 WARN [Listener at localhost/44871] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:02:48,184 WARN [Listener at localhost/44871] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:02:48,204 WARN [Listener at localhost/44871] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:02:48,211 INFO [Listener at localhost/44871] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:02:48,217 INFO [Listener at localhost/44871] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/java.io.tmpdir/Jetty_localhost_45823_datanode____.2ykwch/webapp 2023-02-09 06:02:48,332 INFO [Listener at localhost/44871] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45823 2023-02-09 06:02:48,822 WARN [Listener at localhost/42275] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:02:48,852 WARN [Listener at localhost/42275] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:02:48,858 WARN [Listener at localhost/42275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:02:48,860 INFO [Listener at localhost/42275] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:02:48,878 INFO [Listener at localhost/42275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/java.io.tmpdir/Jetty_localhost_40351_datanode____.tr2x6u/webapp 2023-02-09 06:02:49,001 INFO [Listener at localhost/42275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40351 2023-02-09 06:02:49,012 WARN [Listener at localhost/45571] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:02:49,312 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c12964bcfcef71e: Processing first storage report for DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4 from datanode 9ccac1d8-3c48-4633-91b5-bf4d311f8cc9 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c12964bcfcef71e: from storage DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4 node DatanodeRegistration(127.0.0.1:34227, datanodeUuid=9ccac1d8-3c48-4633-91b5-bf4d311f8cc9, infoPort=46811, infoSecurePort=0, ipcPort=42275, storageInfo=lv=-57;cid=testClusterID;nsid=1897781817;c=1675922567002), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1897c741efef4d63: Processing first storage report for DS-8618f0ee-19d4-4415-9c23-d7df33375a1f from datanode 02ec61e9-cec7-472e-96dc-f98f0afa8358 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1897c741efef4d63: from storage DS-8618f0ee-19d4-4415-9c23-d7df33375a1f node DatanodeRegistration(127.0.0.1:44837, datanodeUuid=02ec61e9-cec7-472e-96dc-f98f0afa8358, infoPort=35241, infoSecurePort=0, ipcPort=45571, storageInfo=lv=-57;cid=testClusterID;nsid=1897781817;c=1675922567002), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c12964bcfcef71e: Processing first storage report for DS-2ec7da34-368f-472c-8dd7-2bc3a636d4de from datanode 9ccac1d8-3c48-4633-91b5-bf4d311f8cc9 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c12964bcfcef71e: from storage DS-2ec7da34-368f-472c-8dd7-2bc3a636d4de node DatanodeRegistration(127.0.0.1:34227, datanodeUuid=9ccac1d8-3c48-4633-91b5-bf4d311f8cc9, infoPort=46811, infoSecurePort=0, ipcPort=42275, storageInfo=lv=-57;cid=testClusterID;nsid=1897781817;c=1675922567002), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:02:49,314 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1897c741efef4d63: Processing first storage report for DS-e5cebc38-9637-4bfd-999d-a5a23ef04438 from datanode 02ec61e9-cec7-472e-96dc-f98f0afa8358 2023-02-09 06:02:49,315 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1897c741efef4d63: from storage DS-e5cebc38-9637-4bfd-999d-a5a23ef04438 node DatanodeRegistration(127.0.0.1:44837, datanodeUuid=02ec61e9-cec7-472e-96dc-f98f0afa8358, infoPort=35241, infoSecurePort=0, ipcPort=45571, storageInfo=lv=-57;cid=testClusterID;nsid=1897781817;c=1675922567002), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 06:02:49,420 DEBUG [Listener at localhost/45571] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68 2023-02-09 06:02:49,508 INFO [Listener at localhost/45571] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/zookeeper_0, clientPort=56060, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:02:49,526 INFO [Listener at localhost/45571] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56060 2023-02-09 06:02:49,536 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:49,538 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:50,235 INFO [Listener at localhost/45571] util.FSUtils(479): Created version file at hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da with version=8 2023-02-09 06:02:50,235 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:50,237 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:50,240 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/hbase-staging 2023-02-09 06:02:50,558 INFO [Listener at localhost/45571] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 06:02:51,011 INFO [Listener at localhost/45571] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:02:51,044 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,044 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,045 INFO [Listener at localhost/45571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:02:51,045 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,045 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:02:51,191 INFO [Listener at localhost/45571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:02:51,261 DEBUG [Listener at localhost/45571] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 06:02:51,351 INFO [Listener at localhost/45571] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45807 2023-02-09 06:02:51,361 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,363 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,386 INFO [Listener at localhost/45571] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45807 connecting to ZooKeeper ensemble=127.0.0.1:56060 2023-02-09 06:02:51,432 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:458070x0, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:02:51,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45807-0x10037ace2d20000 connected 2023-02-09 06:02:51,461 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:02:51,462 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:02:51,466 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:02:51,474 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45807 2023-02-09 06:02:51,474 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45807 2023-02-09 06:02:51,475 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45807 2023-02-09 06:02:51,475 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45807 2023-02-09 06:02:51,475 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45807 2023-02-09 06:02:51,482 INFO [Listener at localhost/45571] master.HMaster(439): hbase.rootdir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da, hbase.cluster.distributed=false 2023-02-09 06:02:51,551 INFO [Listener at localhost/45571] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:02:51,551 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,552 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,552 INFO [Listener at localhost/45571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:02:51,552 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,552 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:02:51,557 INFO [Listener at localhost/45571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:02:51,560 INFO [Listener at localhost/45571] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45185 2023-02-09 06:02:51,562 INFO [Listener at localhost/45571] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:02:51,569 DEBUG [Listener at localhost/45571] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:02:51,570 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,572 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,574 INFO [Listener at localhost/45571] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45185 connecting to ZooKeeper ensemble=127.0.0.1:56060 2023-02-09 06:02:51,578 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:451850x0, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:02:51,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45185-0x10037ace2d20001 connected 2023-02-09 06:02:51,579 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:02:51,580 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:02:51,581 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:02:51,583 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-09 06:02:51,583 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45185 2023-02-09 06:02:51,584 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45185 2023-02-09 06:02:51,584 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-09 06:02:51,584 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-09 06:02:51,597 INFO [Listener at localhost/45571] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:02:51,597 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,598 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,598 INFO [Listener at localhost/45571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:02:51,598 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:02:51,598 INFO [Listener at localhost/45571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:02:51,599 INFO [Listener at localhost/45571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:02:51,600 INFO [Listener at localhost/45571] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37579 2023-02-09 06:02:51,601 INFO [Listener at localhost/45571] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:02:51,606 DEBUG [Listener at localhost/45571] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:02:51,607 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,609 INFO [Listener at localhost/45571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,612 INFO [Listener at localhost/45571] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37579 connecting to ZooKeeper ensemble=127.0.0.1:56060 2023-02-09 06:02:51,618 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:375790x0, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:02:51,619 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:375790x0, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:02:51,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37579-0x10037ace2d20002 connected 2023-02-09 06:02:51,620 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:02:51,621 DEBUG [Listener at localhost/45571] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:02:51,621 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37579 2023-02-09 06:02:51,624 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37579 2023-02-09 06:02:51,624 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37579 2023-02-09 06:02:51,625 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37579 2023-02-09 06:02:51,625 DEBUG [Listener at localhost/45571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37579 2023-02-09 06:02:51,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:51,635 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:02:51,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:51,658 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:02:51,658 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:02:51,658 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:02:51,659 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:51,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:02:51,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45807,1675922570397 from backup master directory 2023-02-09 06:02:51,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:02:51,664 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:51,665 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:02:51,665 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:02:51,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:51,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 06:02:51,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 06:02:51,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/hbase.id with ID: fbde41c5-4531-4fa3-8851-b37ab8261d4e 2023-02-09 06:02:51,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:02:51,823 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:51,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b2b9bbe to 127.0.0.1:56060 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:02:51,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27af3b59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:02:51,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:02:51,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:02:51,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 06:02:51,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 06:02:51,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 06:02:51,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 06:02:51,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:02:51,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store-tmp 2023-02-09 06:02:52,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:52,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:02:52,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:02:52,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:02:52,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:02:52,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:02:52,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:02:52,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922572031Disabling compacts and flushes for region at 1675922572032 (+1 ms)Disabling writes for close at 1675922572032Writing region close event to WAL at 1675922572032Closed at 1675922572032 2023-02-09 06:02:52,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/WALs/jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:52,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45807%2C1675922570397, suffix=, logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/WALs/jenkins-hbase4.apache.org,45807,1675922570397, archiveDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/oldWALs, maxLogs=10 2023-02-09 06:02:52,146 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK] 2023-02-09 06:02:52,146 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK] 2023-02-09 06:02:52,159 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 06:02:52,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/WALs/jenkins-hbase4.apache.org,45807,1675922570397/jenkins-hbase4.apache.org%2C45807%2C1675922570397.1675922572082 2023-02-09 06:02:52,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK], DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK]] 2023-02-09 06:02:52,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:02:52,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:52,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,309 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,317 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:02:52,350 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:02:52,362 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:52,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:02:52,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:52,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65579938, jitterRate=-0.02278277277946472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:02:52,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922572275Initializing all the Stores at 1675922572277 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922572278 (+1 ms)Cleaning up temporary data from old regions at 1675922572376 (+98 ms)Cleaning up detritus from prior splits at 1675922572377 (+1 ms)Region opened successfully at 1675922572393 (+16 ms) 2023-02-09 06:02:52,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:02:52,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:02:52,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:02:52,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:02:52,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 06:02:52,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-09 06:02:52,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:02:52,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:02:52,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:02:52,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:02:52,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:02:52,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:02:52,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:02:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:02:52,551 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:52,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:02:52,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:02:52,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:02:52,572 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:02:52,572 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:02:52,572 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:52,572 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:02:52,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45807,1675922570397, sessionid=0x10037ace2d20000, setting cluster-up flag (Was=false) 2023-02-09 06:02:52,595 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:52,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:02:52,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:52,607 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:52,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:02:52,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:52,620 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/.tmp 2023-02-09 06:02:52,629 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(952): ClusterId : fbde41c5-4531-4fa3-8851-b37ab8261d4e 2023-02-09 06:02:52,629 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(952): ClusterId : fbde41c5-4531-4fa3-8851-b37ab8261d4e 2023-02-09 06:02:52,635 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:02:52,635 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:02:52,641 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:02:52,641 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:02:52,641 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:02:52,641 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:02:52,645 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:02:52,645 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:02:52,646 DEBUG [RS:1;jenkins-hbase4:37579] zookeeper.ReadOnlyZKClient(139): Connect 0x10c45562 to 127.0.0.1:56060 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:02:52,647 DEBUG [RS:0;jenkins-hbase4:45185] zookeeper.ReadOnlyZKClient(139): Connect 0x4f5a54fc to 127.0.0.1:56060 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:02:52,656 DEBUG [RS:1;jenkins-hbase4:37579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c86a3b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:02:52,657 DEBUG [RS:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c78def, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:02:52,657 DEBUG [RS:1;jenkins-hbase4:37579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6879b008, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:02:52,657 DEBUG [RS:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17954246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:02:52,689 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37579 2023-02-09 06:02:52,690 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45185 2023-02-09 06:02:52,696 INFO [RS:1;jenkins-hbase4:37579] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:02:52,696 INFO [RS:0;jenkins-hbase4:45185] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:02:52,697 INFO [RS:0;jenkins-hbase4:45185] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:02:52,697 INFO [RS:1;jenkins-hbase4:37579] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:02:52,697 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:02:52,697 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:02:52,701 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45807,1675922570397 with isa=jenkins-hbase4.apache.org/172.31.14.131:45185, startcode=1675922571550 2023-02-09 06:02:52,701 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45807,1675922570397 with isa=jenkins-hbase4.apache.org/172.31.14.131:37579, startcode=1675922571597 2023-02-09 06:02:52,727 DEBUG [RS:1;jenkins-hbase4:37579] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:02:52,727 DEBUG [RS:0;jenkins-hbase4:45185] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:02:52,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:02:52,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:02:52,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:02:52,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:02:52,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:02:52,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:02:52,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:52,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:02:52,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:52,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922602793 2023-02-09 06:02:52,795 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49851, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:02:52,795 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42257, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:02:52,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:02:52,802 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:02:52,803 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:02:52,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45807] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:02:52,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:02:52,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:02:52,810 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:02:52,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:02:52,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:02:52,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:02:52,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:02:52,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:52,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:02:52,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:02:52,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:02:52,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:02:52,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:02:52,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922572834,5,FailOnTimeoutGroup] 2023-02-09 06:02:52,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922572834,5,FailOnTimeoutGroup] 2023-02-09 06:02:52,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:52,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:02:52,841 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 06:02:52,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:52,843 WARN [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 06:02:52,841 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 06:02:52,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:52,844 WARN [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 06:02:52,853 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:02:52,854 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:02:52,855 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da 2023-02-09 06:02:52,873 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:52,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:02:52,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/info 2023-02-09 06:02:52,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:02:52,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:52,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:02:52,884 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:02:52,884 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:02:52,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:52,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:02:52,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/table 2023-02-09 06:02:52,888 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:02:52,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:52,891 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740 2023-02-09 06:02:52,892 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740 2023-02-09 06:02:52,896 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:02:52,899 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:02:52,903 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:52,904 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71679737, jitterRate=0.06811131536960602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:02:52,905 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922572873Initializing all the Stores at 1675922572875 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922572875Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922572875Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922572876 (+1 ms)Cleaning up temporary data from old regions at 1675922572894 (+18 ms)Cleaning up detritus from prior splits at 1675922572894Region opened successfully at 1675922572905 (+11 ms) 2023-02-09 06:02:52,905 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:02:52,905 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:02:52,905 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:02:52,905 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:02:52,905 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:02:52,906 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:02:52,907 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922572905Disabling compacts and flushes for region at 1675922572905Disabling writes for close at 1675922572905Writing region close event to WAL at 1675922572906 (+1 ms)Closed at 1675922572906 2023-02-09 06:02:52,912 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:02:52,913 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:02:52,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:02:52,935 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:02:52,938 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:02:53,088 WARN [jenkins-hbase4:45807] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-09 06:02:53,844 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45807,1675922570397 with isa=jenkins-hbase4.apache.org/172.31.14.131:37579, startcode=1675922571597 2023-02-09 06:02:53,845 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45807,1675922570397 with isa=jenkins-hbase4.apache.org/172.31.14.131:45185, startcode=1675922571550 2023-02-09 06:02:53,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:53,851 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45807] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:53,857 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da 2023-02-09 06:02:53,857 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da 2023-02-09 06:02:53,858 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44871 2023-02-09 06:02:53,858 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44871 2023-02-09 06:02:53,858 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:02:53,858 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:02:53,874 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:02:53,874 DEBUG [RS:0;jenkins-hbase4:45185] zookeeper.ZKUtil(162): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:53,874 DEBUG [RS:1;jenkins-hbase4:37579] zookeeper.ZKUtil(162): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:53,875 WARN [RS:0;jenkins-hbase4:45185] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:02:53,875 WARN [RS:1;jenkins-hbase4:37579] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:02:53,875 INFO [RS:0;jenkins-hbase4:45185] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:02:53,875 INFO [RS:1;jenkins-hbase4:37579] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:02:53,876 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:53,876 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:53,877 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45185,1675922571550] 2023-02-09 06:02:53,877 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37579,1675922571597] 2023-02-09 06:02:53,887 DEBUG [RS:1;jenkins-hbase4:37579] zookeeper.ZKUtil(162): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:53,887 DEBUG [RS:0;jenkins-hbase4:45185] zookeeper.ZKUtil(162): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:53,888 DEBUG [RS:1;jenkins-hbase4:37579] zookeeper.ZKUtil(162): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:53,888 DEBUG [RS:0;jenkins-hbase4:45185] zookeeper.ZKUtil(162): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:53,899 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:02:53,899 DEBUG [RS:0;jenkins-hbase4:45185] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:02:53,909 INFO [RS:0;jenkins-hbase4:45185] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:02:53,909 INFO [RS:1;jenkins-hbase4:37579] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:02:53,932 INFO [RS:0;jenkins-hbase4:45185] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:02:53,932 INFO [RS:1;jenkins-hbase4:37579] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:02:53,937 INFO [RS:1;jenkins-hbase4:37579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:02:53,937 INFO [RS:0;jenkins-hbase4:45185] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:02:53,938 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,938 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,939 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:02:53,939 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:02:53,948 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,948 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,949 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,949 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,949 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,949 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:02:53,950 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:02:53,950 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,950 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:0;jenkins-hbase4:45185] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,951 DEBUG [RS:1;jenkins-hbase4:37579] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:02:53,953 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,953 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,953 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,953 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,954 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,954 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,974 INFO [RS:1;jenkins-hbase4:37579] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:02:53,974 INFO [RS:0;jenkins-hbase4:45185] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:02:53,978 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1675922571550-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:53,978 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37579,1675922571597-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,003 INFO [RS:0;jenkins-hbase4:45185] regionserver.Replication(203): jenkins-hbase4.apache.org,45185,1675922571550 started 2023-02-09 06:02:54,003 INFO [RS:1;jenkins-hbase4:37579] regionserver.Replication(203): jenkins-hbase4.apache.org,37579,1675922571597 started 2023-02-09 06:02:54,003 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45185,1675922571550, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45185, sessionid=0x10037ace2d20001 2023-02-09 06:02:54,003 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37579,1675922571597, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37579, sessionid=0x10037ace2d20002 2023-02-09 06:02:54,004 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:02:54,004 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:02:54,004 DEBUG [RS:1;jenkins-hbase4:37579] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:54,004 DEBUG [RS:0;jenkins-hbase4:45185] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:54,005 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37579,1675922571597' 2023-02-09 06:02:54,005 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45185,1675922571550' 2023-02-09 06:02:54,005 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:02:54,005 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:02:54,006 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:02:54,006 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:02:54,007 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:02:54,007 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:02:54,007 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:02:54,007 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:02:54,007 DEBUG [RS:1;jenkins-hbase4:37579] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:54,007 DEBUG [RS:0;jenkins-hbase4:45185] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:54,007 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37579,1675922571597' 2023-02-09 06:02:54,007 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:54,007 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45185,1675922571550' 2023-02-09 06:02:54,008 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:54,008 DEBUG [RS:1;jenkins-hbase4:37579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:54,008 DEBUG [RS:0;jenkins-hbase4:45185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:54,009 DEBUG [RS:1;jenkins-hbase4:37579] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:02:54,009 DEBUG [RS:0;jenkins-hbase4:45185] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:02:54,009 INFO [RS:1;jenkins-hbase4:37579] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:02:54,009 INFO [RS:0;jenkins-hbase4:45185] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:02:54,009 INFO [RS:1;jenkins-hbase4:37579] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:02:54,009 INFO [RS:0;jenkins-hbase4:45185] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:02:54,091 DEBUG [jenkins-hbase4:45807] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:02:54,097 DEBUG [jenkins-hbase4:45807] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:02:54,103 DEBUG [jenkins-hbase4:45807] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:02:54,103 DEBUG [jenkins-hbase4:45807] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:02:54,104 DEBUG [jenkins-hbase4:45807] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:02:54,107 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37579,1675922571597, state=OPENING 2023-02-09 06:02:54,115 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:02:54,116 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:54,117 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:02:54,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:54,308 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:54,310 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:02:54,313 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59642, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:02:54,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:02:54,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:02:54,330 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37579%2C1675922571597.meta, suffix=.meta, logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,37579,1675922571597, archiveDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs, maxLogs=32 2023-02-09 06:02:54,353 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK] 2023-02-09 06:02:54,354 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK] 2023-02-09 06:02:54,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,37579,1675922571597/jenkins-hbase4.apache.org%2C37579%2C1675922571597.meta.1675922574335.meta 2023-02-09 06:02:54,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK], DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK]] 2023-02-09 06:02:54,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:02:54,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:02:54,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:02:54,387 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:02:54,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:02:54,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:54,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:02:54,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:02:54,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:02:54,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/info 2023-02-09 06:02:54,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/info 2023-02-09 06:02:54,398 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:02:54,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:54,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:02:54,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:02:54,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:02:54,402 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:02:54,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:54,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:02:54,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/table 2023-02-09 06:02:54,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/table 2023-02-09 06:02:54,405 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:02:54,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:54,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740 2023-02-09 06:02:54,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740 2023-02-09 06:02:54,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:02:54,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:02:54,422 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74347943, jitterRate=0.1078706830739975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:02:54,422 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922574393Writing region info on filesystem at 1675922574394 (+1 ms)Initializing all the Stores at 1675922574395 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922574395Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922574396 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922574396Cleaning up temporary data from old regions at 1675922574414 (+18 ms)Cleaning up detritus from prior splits at 1675922574415 (+1 ms)Running coprocessor post-open hooks at 1675922574422 (+7 ms)Region opened successfully at 1675922574422 2023-02-09 06:02:54,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922574300 2023-02-09 06:02:54,460 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:02:54,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:02:54,461 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37579,1675922571597, state=OPEN 2023-02-09 06:02:54,465 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:02:54,465 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:02:54,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:02:54,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37579,1675922571597 in 344 msec 2023-02-09 06:02:54,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:02:54,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5480 sec 2023-02-09 06:02:54,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7880 sec 2023-02-09 06:02:54,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922571654, completionTime=-1 2023-02-09 06:02:54,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:02:54,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:02:54,551 DEBUG [hconnection-0x9fccb0b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:02:54,554 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:02:54,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:02:54,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922634572 2023-02-09 06:02:54,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922694572 2023-02-09 06:02:54,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 90 msec 2023-02-09 06:02:54,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45807,1675922570397-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45807,1675922570397-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45807,1675922570397-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45807, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:02:54,607 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:02:54,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:02:54,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:02:54,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:02:54,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:02:54,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:02:54,662 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:54,666 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57 empty. 2023-02-09 06:02:54,667 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:54,667 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:02:54,695 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:02:54,698 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 267b5d2e66b3c39e3c2f122b5d5e6f57, NAME => 'hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:54,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:54,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 267b5d2e66b3c39e3c2f122b5d5e6f57, disabling compactions & flushes 2023-02-09 06:02:54,716 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:54,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:54,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. after waiting 0 ms 2023-02-09 06:02:54,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:54,716 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:54,717 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 267b5d2e66b3c39e3c2f122b5d5e6f57: Waiting for close lock at 1675922574716Disabling compacts and flushes for region at 1675922574716Disabling writes for close at 1675922574716Writing region close event to WAL at 1675922574716Closed at 1675922574716 2023-02-09 06:02:54,721 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:02:54,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922574725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922574725"}]},"ts":"1675922574725"} 2023-02-09 06:02:54,775 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:02:54,777 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:02:54,782 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922574777"}]},"ts":"1675922574777"} 2023-02-09 06:02:54,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:02:54,791 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:02:54,793 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:02:54,793 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:02:54,793 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:02:54,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=267b5d2e66b3c39e3c2f122b5d5e6f57, ASSIGN}] 2023-02-09 06:02:54,799 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=267b5d2e66b3c39e3c2f122b5d5e6f57, ASSIGN 2023-02-09 06:02:54,802 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=267b5d2e66b3c39e3c2f122b5d5e6f57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:54,954 INFO [jenkins-hbase4:45807] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:02:54,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=267b5d2e66b3c39e3c2f122b5d5e6f57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:54,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922574955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922574955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922574955"}]},"ts":"1675922574955"} 2023-02-09 06:02:54,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 267b5d2e66b3c39e3c2f122b5d5e6f57, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:55,025 INFO [RS:0;jenkins-hbase4:45185] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45185%2C1675922571550, suffix=, logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,45185,1675922571550, archiveDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs, maxLogs=32 2023-02-09 06:02:55,025 INFO [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37579%2C1675922571597, suffix=, logDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,37579,1675922571597, archiveDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs, maxLogs=32 2023-02-09 06:02:55,045 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK] 2023-02-09 06:02:55,046 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK] 2023-02-09 06:02:55,052 INFO [RS:0;jenkins-hbase4:45185] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,45185,1675922571550/jenkins-hbase4.apache.org%2C45185%2C1675922571550.1675922575027 2023-02-09 06:02:55,052 DEBUG [RS:0;jenkins-hbase4:45185] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK], DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK]] 2023-02-09 06:02:55,055 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK] 2023-02-09 06:02:55,055 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK] 2023-02-09 06:02:55,061 INFO [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/WALs/jenkins-hbase4.apache.org,37579,1675922571597/jenkins-hbase4.apache.org%2C37579%2C1675922571597.1675922575028 2023-02-09 06:02:55,061 DEBUG [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34227,DS-d76da6d3-cb4d-44fa-996d-b30a0f9997b4,DISK], DatanodeInfoWithStorage[127.0.0.1:44837,DS-8618f0ee-19d4-4415-9c23-d7df33375a1f,DISK]] 2023-02-09 06:02:55,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:55,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 267b5d2e66b3c39e3c2f122b5d5e6f57, NAME => 'hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:02:55,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,128 INFO [StoreOpener-267b5d2e66b3c39e3c2f122b5d5e6f57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,130 DEBUG [StoreOpener-267b5d2e66b3c39e3c2f122b5d5e6f57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/info 2023-02-09 06:02:55,130 DEBUG [StoreOpener-267b5d2e66b3c39e3c2f122b5d5e6f57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/info 2023-02-09 06:02:55,131 INFO [StoreOpener-267b5d2e66b3c39e3c2f122b5d5e6f57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 267b5d2e66b3c39e3c2f122b5d5e6f57 columnFamilyName info 2023-02-09 06:02:55,131 INFO [StoreOpener-267b5d2e66b3c39e3c2f122b5d5e6f57-1] regionserver.HStore(310): Store=267b5d2e66b3c39e3c2f122b5d5e6f57/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:55,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,135 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:02:55,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:55,144 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 267b5d2e66b3c39e3c2f122b5d5e6f57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67070146, jitterRate=-5.769431591033936E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:02:55,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 267b5d2e66b3c39e3c2f122b5d5e6f57: Running coprocessor pre-open hook at 1675922575126Writing region info on filesystem at 1675922575126Initializing all the Stores at 1675922575127 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922575127Cleaning up temporary data from old regions at 1675922575135 (+8 ms)Cleaning up detritus from prior splits at 1675922575136 (+1 ms)Running coprocessor post-open hooks at 1675922575144 (+8 ms)Region opened successfully at 1675922575144 2023-02-09 06:02:55,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57., pid=6, masterSystemTime=1675922575116 2023-02-09 06:02:55,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:55,151 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:02:55,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=267b5d2e66b3c39e3c2f122b5d5e6f57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:55,153 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922575152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922575152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922575152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922575152"}]},"ts":"1675922575152"} 2023-02-09 06:02:55,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:02:55,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 267b5d2e66b3c39e3c2f122b5d5e6f57, server=jenkins-hbase4.apache.org,37579,1675922571597 in 195 msec 2023-02-09 06:02:55,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:02:55,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=267b5d2e66b3c39e3c2f122b5d5e6f57, ASSIGN in 365 msec 2023-02-09 06:02:55,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:02:55,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922575167"}]},"ts":"1675922575167"} 2023-02-09 06:02:55,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:02:55,175 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:02:55,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 558 msec 2023-02-09 06:02:55,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:02:55,230 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:02:55,230 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:02:55,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:02:55,295 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:02:55,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-09 06:02:55,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:02:55,322 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:02:55,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-09 06:02:55,336 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:02:55,341 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:02:55,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.675sec 2023-02-09 06:02:55,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:02:55,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:02:55,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:02:55,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45807,1675922570397-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:02:55,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45807,1675922570397-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:02:55,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:02:55,442 DEBUG [Listener at localhost/45571] zookeeper.ReadOnlyZKClient(139): Connect 0x3b8ae91a to 127.0.0.1:56060 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:02:55,447 DEBUG [Listener at localhost/45571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8795d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:02:55,503 DEBUG [hconnection-0x254e1275-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:02:55,516 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:02:55,526 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:02:55,527 DEBUG [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:02:55,528 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,529 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,536 DEBUG [Listener at localhost/45571] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:02:55,540 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:02:55,545 INFO [Listener at localhost/45571] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 06:02:55,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 06:02:55,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:02:55,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:39780 deadline: 1675922635549, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 06:02:55,553 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 06:02:55,554 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,554 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:55,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:02:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 06:02:55,570 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:02:55,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:02:55,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 06:02:55,582 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,583 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:55,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:02:55,596 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:55,596 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:55,596 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:55,596 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:55,597 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:55,597 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:55,597 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:55,597 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:55,598 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d empty. 2023-02-09 06:02:55,598 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae empty. 2023-02-09 06:02:55,598 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a empty. 2023-02-09 06:02:55,598 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 empty. 2023-02-09 06:02:55,599 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:55,599 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:55,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b empty. 2023-02-09 06:02:55,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 empty. 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead empty. 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de empty. 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab empty. 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:55,600 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:55,601 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:55,601 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 empty. 2023-02-09 06:02:55,601 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:55,603 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:55,603 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:55,603 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:55,603 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 06:02:55,622 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 06:02:55,624 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 067d02b89b340f1c494ce1a92146ed89, NAME => 'testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,625 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 768d94cc6e8029a7fb8e5393029b630d, NAME => 'testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,625 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d77ed01555a6aa928eaf72551d4179de, NAME => 'testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,667 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 768d94cc6e8029a7fb8e5393029b630d, disabling compactions & flushes 2023-02-09 06:02:55,668 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:55,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:55,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. after waiting 0 ms 2023-02-09 06:02:55,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:55,669 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:55,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 768d94cc6e8029a7fb8e5393029b630d: Waiting for close lock at 1675922575668Disabling compacts and flushes for region at 1675922575668Disabling writes for close at 1675922575668Writing region close event to WAL at 1675922575668Closed at 1675922575668 2023-02-09 06:02:55,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,670 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ab569df1f165c28a5f897f3cd8a8bead, NAME => 'testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d77ed01555a6aa928eaf72551d4179de, disabling compactions & flushes 2023-02-09 06:02:55,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 067d02b89b340f1c494ce1a92146ed89, disabling compactions & flushes 2023-02-09 06:02:55,671 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:55,670 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. after waiting 0 ms 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. after waiting 0 ms 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:55,671 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:55,671 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 067d02b89b340f1c494ce1a92146ed89: Waiting for close lock at 1675922575670Disabling compacts and flushes for region at 1675922575670Disabling writes for close at 1675922575671 (+1 ms)Writing region close event to WAL at 1675922575671Closed at 1675922575671 2023-02-09 06:02:55,671 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d77ed01555a6aa928eaf72551d4179de: Waiting for close lock at 1675922575670Disabling compacts and flushes for region at 1675922575670Disabling writes for close at 1675922575671 (+1 ms)Writing region close event to WAL at 1675922575671Closed at 1675922575671 2023-02-09 06:02:55,672 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4d26fbb2c4c0d8680c922798bd27af0b, NAME => 'testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,672 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c8ad95cd507414518521fd4735f22057, NAME => 'testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,696 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,699 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:55,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4d26fbb2c4c0d8680c922798bd27af0b, disabling compactions & flushes 2023-02-09 06:02:55,713 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. after waiting 0 ms 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:55,714 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:55,714 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4d26fbb2c4c0d8680c922798bd27af0b: Waiting for close lock at 1675922575713Disabling compacts and flushes for region at 1675922575713Disabling writes for close at 1675922575713Writing region close event to WAL at 1675922575714 (+1 ms)Closed at 1675922575714 2023-02-09 06:02:55,714 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 26c4d47bb37328c6404c7d590e7f4f3a, NAME => 'testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,714 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,715 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c8ad95cd507414518521fd4735f22057, disabling compactions & flushes 2023-02-09 06:02:55,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ab569df1f165c28a5f897f3cd8a8bead, disabling compactions & flushes 2023-02-09 06:02:55,715 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:55,715 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:55,715 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. after waiting 0 ms 2023-02-09 06:02:55,715 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:55,715 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:55,716 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:55,716 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:55,716 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. after waiting 0 ms 2023-02-09 06:02:55,716 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c8ad95cd507414518521fd4735f22057: Waiting for close lock at 1675922575715Disabling compacts and flushes for region at 1675922575715Disabling writes for close at 1675922575715Writing region close event to WAL at 1675922575716 (+1 ms)Closed at 1675922575716 2023-02-09 06:02:55,716 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:55,716 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:55,716 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ab569df1f165c28a5f897f3cd8a8bead: Waiting for close lock at 1675922575713Disabling compacts and flushes for region at 1675922575713Disabling writes for close at 1675922575716 (+3 ms)Writing region close event to WAL at 1675922575716Closed at 1675922575716 2023-02-09 06:02:55,716 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ade1186b313ff778b76c80d8ab0915ae, NAME => 'testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,717 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ab8cdcd9565266ef061196394896cab, NAME => 'testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,741 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,742 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 26c4d47bb37328c6404c7d590e7f4f3a, disabling compactions & flushes 2023-02-09 06:02:55,742 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:55,742 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:55,742 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. after waiting 0 ms 2023-02-09 06:02:55,742 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:55,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:55,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 26c4d47bb37328c6404c7d590e7f4f3a: Waiting for close lock at 1675922575742Disabling compacts and flushes for region at 1675922575742Disabling writes for close at 1675922575742Writing region close event to WAL at 1675922575743 (+1 ms)Closed at 1675922575743 2023-02-09 06:02:55,744 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7e63f587506e353275a955c0e7af4076, NAME => 'testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp 2023-02-09 06:02:55,746 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5ab8cdcd9565266ef061196394896cab, disabling compactions & flushes 2023-02-09 06:02:55,747 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. after waiting 0 ms 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:55,747 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5ab8cdcd9565266ef061196394896cab: Waiting for close lock at 1675922575747Disabling compacts and flushes for region at 1675922575747Disabling writes for close at 1675922575747Writing region close event to WAL at 1675922575747Closed at 1675922575747 2023-02-09 06:02:55,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ade1186b313ff778b76c80d8ab0915ae, disabling compactions & flushes 2023-02-09 06:02:55,748 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:55,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:55,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. after waiting 0 ms 2023-02-09 06:02:55,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:55,748 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:55,749 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ade1186b313ff778b76c80d8ab0915ae: Waiting for close lock at 1675922575748Disabling compacts and flushes for region at 1675922575748Disabling writes for close at 1675922575748Writing region close event to WAL at 1675922575748Closed at 1675922575748 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7e63f587506e353275a955c0e7af4076, disabling compactions & flushes 2023-02-09 06:02:55,772 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. after waiting 0 ms 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:55,772 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:55,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7e63f587506e353275a955c0e7af4076: Waiting for close lock at 1675922575772Disabling compacts and flushes for region at 1675922575772Disabling writes for close at 1675922575772Writing region close event to WAL at 1675922575772Closed at 1675922575772 2023-02-09 06:02:55,778 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:02:55,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922575779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922575779"}]},"ts":"1675922575779"} 2023-02-09 06:02:55,835 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 06:02:55,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:02:55,838 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922575837"}]},"ts":"1675922575837"} 2023-02-09 06:02:55,840 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 06:02:55,846 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:02:55,858 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:02:55,859 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:02:55,859 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:02:55,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, ASSIGN}] 2023-02-09 06:02:55,864 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, ASSIGN 2023-02-09 06:02:55,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, ASSIGN 2023-02-09 06:02:55,865 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, ASSIGN 2023-02-09 06:02:55,865 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, ASSIGN 2023-02-09 06:02:55,866 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45185,1675922571550; forceNewPlan=false, retain=false 2023-02-09 06:02:55,867 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45185,1675922571550; forceNewPlan=false, retain=false 2023-02-09 06:02:55,867 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:55,867 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:55,868 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, ASSIGN 2023-02-09 06:02:55,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, ASSIGN 2023-02-09 06:02:55,870 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, ASSIGN 2023-02-09 06:02:55,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, ASSIGN 2023-02-09 06:02:55,871 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:55,871 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, ASSIGN 2023-02-09 06:02:55,871 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45185,1675922571550; forceNewPlan=false, retain=false 2023-02-09 06:02:55,872 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:55,872 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45185,1675922571550; forceNewPlan=false, retain=false 2023-02-09 06:02:55,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, ASSIGN 2023-02-09 06:02:55,873 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45185,1675922571550; forceNewPlan=false, retain=false 2023-02-09 06:02:55,874 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37579,1675922571597; forceNewPlan=false, retain=false 2023-02-09 06:02:55,907 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:55,907 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:55,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:02:56,016 INFO [jenkins-hbase4:45807] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 06:02:56,021 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=26c4d47bb37328c6404c7d590e7f4f3a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,021 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d77ed01555a6aa928eaf72551d4179de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576020"}]},"ts":"1675922576020"} 2023-02-09 06:02:56,021 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576021"}]},"ts":"1675922576021"} 2023-02-09 06:02:56,022 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c8ad95cd507414518521fd4735f22057, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576022"}]},"ts":"1675922576022"} 2023-02-09 06:02:56,021 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5ab8cdcd9565266ef061196394896cab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,021 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=768d94cc6e8029a7fb8e5393029b630d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576020"}]},"ts":"1675922576020"} 2023-02-09 06:02:56,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922576021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576021"}]},"ts":"1675922576021"} 2023-02-09 06:02:56,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 26c4d47bb37328c6404c7d590e7f4f3a, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:02:56,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure d77ed01555a6aa928eaf72551d4179de, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:02:56,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure c8ad95cd507414518521fd4735f22057, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:02:56,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 5ab8cdcd9565266ef061196394896cab, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:02:56,037 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ade1186b313ff778b76c80d8ab0915ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure 768d94cc6e8029a7fb8e5393029b630d, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:02:56,037 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576036"}]},"ts":"1675922576036"} 2023-02-09 06:02:56,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure ade1186b313ff778b76c80d8ab0915ae, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:56,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7e63f587506e353275a955c0e7af4076, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,042 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922576041"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576041"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576041"}]},"ts":"1675922576041"} 2023-02-09 06:02:56,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 7e63f587506e353275a955c0e7af4076, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:56,047 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=067d02b89b340f1c494ce1a92146ed89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,047 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576047"}]},"ts":"1675922576047"} 2023-02-09 06:02:56,048 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ab569df1f165c28a5f897f3cd8a8bead, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,048 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576048"}]},"ts":"1675922576048"} 2023-02-09 06:02:56,050 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4d26fbb2c4c0d8680c922798bd27af0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,050 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922576050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922576050"}]},"ts":"1675922576050"} 2023-02-09 06:02:56,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 067d02b89b340f1c494ce1a92146ed89, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:56,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure ab569df1f165c28a5f897f3cd8a8bead, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:56,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 4d26fbb2c4c0d8680c922798bd27af0b, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:02:56,183 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,183 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:02:56,187 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42344, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:02:56,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:56,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 768d94cc6e8029a7fb8e5393029b630d, NAME => 'testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 06:02:56,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,197 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,199 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f1 2023-02-09 06:02:56,200 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f1 2023-02-09 06:02:56,200 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 768d94cc6e8029a7fb8e5393029b630d columnFamilyName f1 2023-02-09 06:02:56,201 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(310): Store=768d94cc6e8029a7fb8e5393029b630d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,202 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,204 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f2 2023-02-09 06:02:56,204 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f2 2023-02-09 06:02:56,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:56,247 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:56,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d26fbb2c4c0d8680c922798bd27af0b, NAME => 'testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 06:02:56,247 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,248 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 768d94cc6e8029a7fb8e5393029b630d columnFamilyName f2 2023-02-09 06:02:56,253 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(310): Store=768d94cc6e8029a7fb8e5393029b630d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:02:56,256 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,258 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1 2023-02-09 06:02:56,258 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1 2023-02-09 06:02:56,259 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d26fbb2c4c0d8680c922798bd27af0b columnFamilyName f1 2023-02-09 06:02:56,260 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(310): Store=4d26fbb2c4c0d8680c922798bd27af0b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,260 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,262 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2 2023-02-09 06:02:56,262 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2 2023-02-09 06:02:56,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:02:56,263 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d26fbb2c4c0d8680c922798bd27af0b columnFamilyName f2 2023-02-09 06:02:56,263 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(310): Store=4d26fbb2c4c0d8680c922798bd27af0b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 768d94cc6e8029a7fb8e5393029b630d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74573898, jitterRate=0.11123767495155334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 768d94cc6e8029a7fb8e5393029b630d: Running coprocessor pre-open hook at 1675922576195Writing region info on filesystem at 1675922576195Initializing all the Stores at 1675922576197 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576197Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576197Cleaning up temporary data from old regions at 1675922576259 (+62 ms)Cleaning up detritus from prior splits at 1675922576259Running coprocessor post-open hooks at 1675922576271 (+12 ms)Region opened successfully at 1675922576271 2023-02-09 06:02:56,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d., pid=25, masterSystemTime=1675922576183 2023-02-09 06:02:56,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:56,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:56,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c8ad95cd507414518521fd4735f22057, NAME => 'testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 06:02:56,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=768d94cc6e8029a7fb8e5393029b630d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922576278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576278"}]},"ts":"1675922576278"} 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:02:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,282 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,285 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1 2023-02-09 06:02:56,285 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1 2023-02-09 06:02:56,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-09 06:02:56,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure 768d94cc6e8029a7fb8e5393029b630d, server=jenkins-hbase4.apache.org,45185,1675922571550 in 245 msec 2023-02-09 06:02:56,286 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8ad95cd507414518521fd4735f22057 columnFamilyName f1 2023-02-09 06:02:56,287 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(310): Store=c8ad95cd507414518521fd4735f22057/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,287 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, ASSIGN in 427 msec 2023-02-09 06:02:56,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d26fbb2c4c0d8680c922798bd27af0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67712985, jitterRate=0.00900210440158844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d26fbb2c4c0d8680c922798bd27af0b: Running coprocessor pre-open hook at 1675922576248Writing region info on filesystem at 1675922576248Initializing all the Stores at 1675922576254 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576254Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576254Cleaning up temporary data from old regions at 1675922576271 (+17 ms)Cleaning up detritus from prior splits at 1675922576272 (+1 ms)Running coprocessor post-open hooks at 1675922576289 (+17 ms)Region opened successfully at 1675922576289 2023-02-09 06:02:56,290 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2 2023-02-09 06:02:56,290 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2 2023-02-09 06:02:56,290 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8ad95cd507414518521fd4735f22057 columnFamilyName f2 2023-02-09 06:02:56,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b., pid=30, masterSystemTime=1675922576199 2023-02-09 06:02:56,292 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(310): Store=c8ad95cd507414518521fd4735f22057/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:56,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:56,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:56,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e63f587506e353275a955c0e7af4076, NAME => 'testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 06:02:56,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,296 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4d26fbb2c4c0d8680c922798bd27af0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,296 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576296"}]},"ts":"1675922576296"} 2023-02-09 06:02:56,299 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,301 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f1 2023-02-09 06:02:56,301 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f1 2023-02-09 06:02:56,302 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e63f587506e353275a955c0e7af4076 columnFamilyName f1 2023-02-09 06:02:56,302 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(310): Store=7e63f587506e353275a955c0e7af4076/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,303 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,305 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f2 2023-02-09 06:02:56,305 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f2 2023-02-09 06:02:56,307 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e63f587506e353275a955c0e7af4076 columnFamilyName f2 2023-02-09 06:02:56,307 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(310): Store=7e63f587506e353275a955c0e7af4076/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c8ad95cd507414518521fd4735f22057 2023-02-09 06:02:56,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-09 06:02:56,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 4d26fbb2c4c0d8680c922798bd27af0b, server=jenkins-hbase4.apache.org,37579,1675922571597 in 251 msec 2023-02-09 06:02:56,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, ASSIGN in 457 msec 2023-02-09 06:02:56,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c8ad95cd507414518521fd4735f22057; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64191398, jitterRate=-0.043473631143569946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c8ad95cd507414518521fd4735f22057: Running coprocessor pre-open hook at 1675922576279Writing region info on filesystem at 1675922576279Initializing all the Stores at 1675922576280 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576281 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576281Cleaning up temporary data from old regions at 1675922576296 (+15 ms)Cleaning up detritus from prior splits at 1675922576297 (+1 ms)Running coprocessor post-open hooks at 1675922576319 (+22 ms)Region opened successfully at 1675922576319 2023-02-09 06:02:56,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057., pid=23, masterSystemTime=1675922576183 2023-02-09 06:02:56,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:56,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:56,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:56,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5ab8cdcd9565266ef061196394896cab, NAME => 'testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 06:02:56,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,324 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c8ad95cd507414518521fd4735f22057, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,324 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576324"}]},"ts":"1675922576324"} 2023-02-09 06:02:56,328 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7e63f587506e353275a955c0e7af4076 2023-02-09 06:02:56,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-09 06:02:56,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure c8ad95cd507414518521fd4735f22057, server=jenkins-hbase4.apache.org,45185,1675922571550 in 298 msec 2023-02-09 06:02:56,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, ASSIGN in 474 msec 2023-02-09 06:02:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7e63f587506e353275a955c0e7af4076; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62690652, jitterRate=-0.06583648920059204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7e63f587506e353275a955c0e7af4076: Running coprocessor pre-open hook at 1675922576296Writing region info on filesystem at 1675922576296Initializing all the Stores at 1675922576298 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576298Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576298Cleaning up temporary data from old regions at 1675922576325 (+27 ms)Cleaning up detritus from prior splits at 1675922576327 (+2 ms)Running coprocessor post-open hooks at 1675922576336 (+9 ms)Region opened successfully at 1675922576336 2023-02-09 06:02:56,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076., pid=27, masterSystemTime=1675922576199 2023-02-09 06:02:56,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:56,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:56,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:56,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 067d02b89b340f1c494ce1a92146ed89, NAME => 'testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 06:02:56,340 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7e63f587506e353275a955c0e7af4076, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,341 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922576340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576340"}]},"ts":"1675922576340"} 2023-02-09 06:02:56,341 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1 2023-02-09 06:02:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,341 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1 2023-02-09 06:02:56,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,343 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab8cdcd9565266ef061196394896cab columnFamilyName f1 2023-02-09 06:02:56,344 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(310): Store=5ab8cdcd9565266ef061196394896cab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,345 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,346 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,348 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2 2023-02-09 06:02:56,348 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2 2023-02-09 06:02:56,348 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab8cdcd9565266ef061196394896cab columnFamilyName f2 2023-02-09 06:02:56,348 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1 2023-02-09 06:02:56,349 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1 2023-02-09 06:02:56,349 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(310): Store=5ab8cdcd9565266ef061196394896cab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-09 06:02:56,349 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067d02b89b340f1c494ce1a92146ed89 columnFamilyName f1 2023-02-09 06:02:56,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 7e63f587506e353275a955c0e7af4076, server=jenkins-hbase4.apache.org,37579,1675922571597 in 301 msec 2023-02-09 06:02:56,351 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(310): Store=067d02b89b340f1c494ce1a92146ed89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,351 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, ASSIGN in 490 msec 2023-02-09 06:02:56,354 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2 2023-02-09 06:02:56,354 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2 2023-02-09 06:02:56,354 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067d02b89b340f1c494ce1a92146ed89 columnFamilyName f2 2023-02-09 06:02:56,355 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(310): Store=067d02b89b340f1c494ce1a92146ed89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:02:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5ab8cdcd9565266ef061196394896cab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66223471, jitterRate=-0.013193383812904358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5ab8cdcd9565266ef061196394896cab: Running coprocessor pre-open hook at 1675922576324Writing region info on filesystem at 1675922576324Initializing all the Stores at 1675922576327 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576327Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576327Cleaning up temporary data from old regions at 1675922576354 (+27 ms)Cleaning up detritus from prior splits at 1675922576354Running coprocessor post-open hooks at 1675922576364 (+10 ms)Region opened successfully at 1675922576364 2023-02-09 06:02:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:02:56,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab., pid=24, masterSystemTime=1675922576183 2023-02-09 06:02:56,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:56,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:56,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:56,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d77ed01555a6aa928eaf72551d4179de, NAME => 'testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 06:02:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,370 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5ab8cdcd9565266ef061196394896cab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 067d02b89b340f1c494ce1a92146ed89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65072034, jitterRate=-0.03035113215446472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,370 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576370"}]},"ts":"1675922576370"} 2023-02-09 06:02:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 067d02b89b340f1c494ce1a92146ed89: Running coprocessor pre-open hook at 1675922576343Writing region info on filesystem at 1675922576343Initializing all the Stores at 1675922576345 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576345Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576345Cleaning up temporary data from old regions at 1675922576361 (+16 ms)Cleaning up detritus from prior splits at 1675922576361Running coprocessor post-open hooks at 1675922576370 (+9 ms)Region opened successfully at 1675922576370 2023-02-09 06:02:56,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89., pid=28, masterSystemTime=1675922576199 2023-02-09 06:02:56,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:56,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:56,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab569df1f165c28a5f897f3cd8a8bead, NAME => 'testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 06:02:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,377 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=067d02b89b340f1c494ce1a92146ed89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,377 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576377"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576377"}]},"ts":"1675922576377"} 2023-02-09 06:02:56,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-09 06:02:56,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 5ab8cdcd9565266ef061196394896cab, server=jenkins-hbase4.apache.org,45185,1675922571550 in 340 msec 2023-02-09 06:02:56,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, ASSIGN in 520 msec 2023-02-09 06:02:56,384 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-09 06:02:56,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 067d02b89b340f1c494ce1a92146ed89, server=jenkins-hbase4.apache.org,37579,1675922571597 in 336 msec 2023-02-09 06:02:56,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, ASSIGN in 532 msec 2023-02-09 06:02:56,393 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,394 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1 2023-02-09 06:02:56,394 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1 2023-02-09 06:02:56,395 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77ed01555a6aa928eaf72551d4179de columnFamilyName f1 2023-02-09 06:02:56,396 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(310): Store=d77ed01555a6aa928eaf72551d4179de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,396 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,397 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1 2023-02-09 06:02:56,397 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1 2023-02-09 06:02:56,398 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab569df1f165c28a5f897f3cd8a8bead columnFamilyName f1 2023-02-09 06:02:56,398 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2 2023-02-09 06:02:56,399 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2 2023-02-09 06:02:56,399 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(310): Store=ab569df1f165c28a5f897f3cd8a8bead/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,399 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,399 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77ed01555a6aa928eaf72551d4179de columnFamilyName f2 2023-02-09 06:02:56,400 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(310): Store=d77ed01555a6aa928eaf72551d4179de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,402 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2 2023-02-09 06:02:56,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,402 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2 2023-02-09 06:02:56,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,403 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab569df1f165c28a5f897f3cd8a8bead columnFamilyName f2 2023-02-09 06:02:56,404 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(310): Store=ab569df1f165c28a5f897f3cd8a8bead/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:02:56,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:02:56,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d77ed01555a6aa928eaf72551d4179de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68519864, jitterRate=0.021025538444519043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d77ed01555a6aa928eaf72551d4179de: Running coprocessor pre-open hook at 1675922576370Writing region info on filesystem at 1675922576370Initializing all the Stores at 1675922576371 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576371Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576383 (+12 ms)Cleaning up temporary data from old regions at 1675922576404 (+21 ms)Cleaning up detritus from prior splits at 1675922576405 (+1 ms)Running coprocessor post-open hooks at 1675922576413 (+8 ms)Region opened successfully at 1675922576413 2023-02-09 06:02:56,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de., pid=22, masterSystemTime=1675922576183 2023-02-09 06:02:56,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:56,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:56,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:56,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 26c4d47bb37328c6404c7d590e7f4f3a, NAME => 'testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 06:02:56,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d77ed01555a6aa928eaf72551d4179de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,418 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576418"}]},"ts":"1675922576418"} 2023-02-09 06:02:56,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,422 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-09 06:02:56,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure d77ed01555a6aa928eaf72551d4179de, server=jenkins-hbase4.apache.org,45185,1675922571550 in 391 msec 2023-02-09 06:02:56,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ab569df1f165c28a5f897f3cd8a8bead; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68218078, jitterRate=0.016528576612472534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,425 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1 2023-02-09 06:02:56,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ab569df1f165c28a5f897f3cd8a8bead: Running coprocessor pre-open hook at 1675922576376Writing region info on filesystem at 1675922576376Initializing all the Stores at 1675922576393 (+17 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576393Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576393Cleaning up temporary data from old regions at 1675922576408 (+15 ms)Cleaning up detritus from prior splits at 1675922576408Running coprocessor post-open hooks at 1675922576425 (+17 ms)Region opened successfully at 1675922576425 2023-02-09 06:02:56,425 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1 2023-02-09 06:02:56,426 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26c4d47bb37328c6404c7d590e7f4f3a columnFamilyName f1 2023-02-09 06:02:56,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead., pid=29, masterSystemTime=1675922576199 2023-02-09 06:02:56,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, ASSIGN in 565 msec 2023-02-09 06:02:56,427 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(310): Store=26c4d47bb37328c6404c7d590e7f4f3a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,427 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:56,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:56,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:56,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ade1186b313ff778b76c80d8ab0915ae, NAME => 'testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 06:02:56,430 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2 2023-02-09 06:02:56,430 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2 2023-02-09 06:02:56,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:02:56,430 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ab569df1f165c28a5f897f3cd8a8bead, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,430 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576430"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576430"}]},"ts":"1675922576430"} 2023-02-09 06:02:56,430 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26c4d47bb37328c6404c7d590e7f4f3a columnFamilyName f2 2023-02-09 06:02:56,431 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(310): Store=26c4d47bb37328c6404c7d590e7f4f3a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,433 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,437 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1 2023-02-09 06:02:56,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-09 06:02:56,437 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1 2023-02-09 06:02:56,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure ab569df1f165c28a5f897f3cd8a8bead, server=jenkins-hbase4.apache.org,37579,1675922571597 in 378 msec 2023-02-09 06:02:56,437 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ade1186b313ff778b76c80d8ab0915ae columnFamilyName f1 2023-02-09 06:02:56,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,438 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(310): Store=ade1186b313ff778b76c80d8ab0915ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,439 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, ASSIGN in 578 msec 2023-02-09 06:02:56,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:02:56,441 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2 2023-02-09 06:02:56,441 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2 2023-02-09 06:02:56,442 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ade1186b313ff778b76c80d8ab0915ae columnFamilyName f2 2023-02-09 06:02:56,443 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(310): Store=ade1186b313ff778b76c80d8ab0915ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:02:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 26c4d47bb37328c6404c7d590e7f4f3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72135514, jitterRate=0.07490292191505432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 26c4d47bb37328c6404c7d590e7f4f3a: Running coprocessor pre-open hook at 1675922576418Writing region info on filesystem at 1675922576418Initializing all the Stores at 1675922576420 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576420Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576422 (+2 ms)Cleaning up temporary data from old regions at 1675922576435 (+13 ms)Cleaning up detritus from prior splits at 1675922576436 (+1 ms)Running coprocessor post-open hooks at 1675922576446 (+10 ms)Region opened successfully at 1675922576446 2023-02-09 06:02:56,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a., pid=21, masterSystemTime=1675922576183 2023-02-09 06:02:56,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:02:56,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:56,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:56,451 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=26c4d47bb37328c6404c7d590e7f4f3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:56,451 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576450"}]},"ts":"1675922576450"} 2023-02-09 06:02:56,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:02:56,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-09 06:02:56,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 26c4d47bb37328c6404c7d590e7f4f3a, server=jenkins-hbase4.apache.org,45185,1675922571550 in 427 msec 2023-02-09 06:02:56,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:02:56,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ade1186b313ff778b76c80d8ab0915ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63899306, jitterRate=-0.047826141119003296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:02:56,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, ASSIGN in 600 msec 2023-02-09 06:02:56,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ade1186b313ff778b76c80d8ab0915ae: Running coprocessor pre-open hook at 1675922576430Writing region info on filesystem at 1675922576430Initializing all the Stores at 1675922576433 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576433Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922576433Cleaning up temporary data from old regions at 1675922576447 (+14 ms)Cleaning up detritus from prior splits at 1675922576448 (+1 ms)Running coprocessor post-open hooks at 1675922576462 (+14 ms)Region opened successfully at 1675922576462 2023-02-09 06:02:56,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae., pid=26, masterSystemTime=1675922576199 2023-02-09 06:02:56,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:56,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:56,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ade1186b313ff778b76c80d8ab0915ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:56,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922576466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922576466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922576466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922576466"}]},"ts":"1675922576466"} 2023-02-09 06:02:56,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-09 06:02:56,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure ade1186b313ff778b76c80d8ab0915ae, server=jenkins-hbase4.apache.org,37579,1675922571597 in 429 msec 2023-02-09 06:02:56,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-09 06:02:56,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, ASSIGN in 613 msec 2023-02-09 06:02:56,476 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:02:56,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922576476"}]},"ts":"1675922576476"} 2023-02-09 06:02:56,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 06:02:56,483 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:02:56,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 917 msec 2023-02-09 06:02:56,754 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:56,754 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:02:56,757 INFO [Listener at localhost/45571] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 06:02:56,757 DEBUG [Listener at localhost/45571] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 06:02:56,759 INFO [Listener at localhost/45571] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:02:56,769 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 06:02:56,770 INFO [Listener at localhost/45571] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:02:56,771 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 06:02:56,771 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:02:56,922 DEBUG [hconnection-0x254e1275-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:02:57,001 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:02:57,036 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37579] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:57,037 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:57,334 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:02:57,339 INFO [Listener at localhost/45571] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:02:57,350 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:57,351 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:57,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:02:57,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922577354 (current time:1675922577354). 2023-02-09 06:02:57,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:02:57,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] zookeeper.ReadOnlyZKClient(139): Connect 0x2033c8a3 to 127.0.0.1:56060 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:02:57,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e5d22d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:02:57,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:02:57,372 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:02:57,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2033c8a3 to 127.0.0.1:56060 2023-02-09 06:02:57,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:02:57,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:02:57,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:02:57,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:02:57,404 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:02:57,406 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675923177406 2023-02-09 06:02:57,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:02:57,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 06:02:57,414 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:02:57,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:02:57,420 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:02:57,420 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:02:57,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 20 msec 2023-02-09 06:02:57,421 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:02:57,422 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675923177422 2023-02-09 06:02:57,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-09 06:02:57,458 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-09 06:02:57,459 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:02:57,459 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-09 06:02:57,459 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 06:02:57,460 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:57,460 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:57,462 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:02:57,462 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:02:57,462 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:02:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:57,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:02:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:57,463 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,463 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:57,464 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,464 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:02:57,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:57,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 06:02:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 06:02:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:57,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 06:02:57,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 06:02:57,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 06:02:57,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 06:02:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 06:02:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:02:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 06:02:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:02:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:02:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 06:02:57,470 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:02:57,470 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 06:02:57,470 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37579,1675922571597' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 06:02:57,470 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45185,1675922571550' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 06:02:57,472 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,472 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:02:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:02:57,473 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:02:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:02:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:02:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:02:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37579,1675922571597' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47ab2168[Count = 1] remaining members to acquire global barrier 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:02:57,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:02:57,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:02:57,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:02:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:02:57,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45185,1675922571550' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 06:02:57,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47ab2168[Count = 0] remaining members to acquire global barrier 2023-02-09 06:02:57,478 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 06:02:57,478 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:57,481 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:57,481 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:02:57,481 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:02:57,482 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:57,482 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:02:57,483 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:57,483 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. started... 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. started... 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. started... 2023-02-09 06:02:57,484 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. started... 2023-02-09 06:02:57,488 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5ab8cdcd9565266ef061196394896cab 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:02:57,488 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 067d02b89b340f1c494ce1a92146ed89 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:57,488 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d77ed01555a6aa928eaf72551d4179de 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:02:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:02:57,489 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:57,489 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. started... 2023-02-09 06:02:57,488 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ab569df1f165c28a5f897f3cd8a8bead 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:02:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:02:57,490 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:02:57,490 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 26c4d47bb37328c6404c7d590e7f4f3a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. started... 2023-02-09 06:02:57,492 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7e63f587506e353275a955c0e7af4076: 2023-02-09 06:02:57,493 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:57,499 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:57,503 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:02:57,503 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:02:57,520 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:02:57,521 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:57,521 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:02:57,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:02:57,527 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:02:57,577 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. completed. 2023-02-09 06:02:57,577 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:57,585 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:57,585 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:02:57,585 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. started... 2023-02-09 06:02:57,586 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4d26fbb2c4c0d8680c922798bd27af0b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:57,727 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:02:57,728 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:57,728 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:57,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:02:57,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:02:57,736 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 06:02:57,748 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f1/791f392dc07840299d59f822eba17856 2023-02-09 06:02:57,748 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f1/8925f1deb61749d389170bcfb9d6490b 2023-02-09 06:02:57,748 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f1/af0061f54a2a4327a2c0549877003e10 2023-02-09 06:02:57,763 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f1/3e7722aa3e514b358710a9b5cef9689c 2023-02-09 06:02:57,765 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f1/76e5147164454f75b44d5cb1ba89f291 2023-02-09 06:02:57,765 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f1/58bf63816844457aa9979d98956210db 2023-02-09 06:02:57,932 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f2/c77ecb6155254bceb60ce8c57f571a41 2023-02-09 06:02:57,968 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f1/58bf63816844457aa9979d98956210db as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db 2023-02-09 06:02:57,977 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:57,979 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f2/c77ecb6155254bceb60ce8c57f571a41 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41 2023-02-09 06:02:57,998 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f2/b72ee1a008354381a9cf770a69c76878 2023-02-09 06:02:58,008 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,009 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f1/8925f1deb61749d389170bcfb9d6490b as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b 2023-02-09 06:02:58,014 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ab569df1f165c28a5f897f3cd8a8bead in 525ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,016 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 06:02:58,017 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f2/aeb772b23d2644f5aeb806a3ca8a070e 2023-02-09 06:02:58,018 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f2/a4362535ab5b4b178879fe67b8501fc2 2023-02-09 06:02:58,022 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ab569df1f165c28a5f897f3cd8a8bead: 2023-02-09 06:02:58,022 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,022 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,022 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db] hfiles 2023-02-09 06:02:58,022 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,025 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:02:58,028 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f2/b72ee1a008354381a9cf770a69c76878 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878 2023-02-09 06:02:58,031 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41] hfiles 2023-02-09 06:02:58,031 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,033 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f1/791f392dc07840299d59f822eba17856 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856 2023-02-09 06:02:58,034 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f1/76e5147164454f75b44d5cb1ba89f291 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291 2023-02-09 06:02:58,037 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:02:58,037 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:58,037 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:58,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:02:58,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:02:58,039 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 06:02:58,043 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:02:58,044 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5ab8cdcd9565266ef061196394896cab in 556ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5ab8cdcd9565266ef061196394896cab: 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b] hfiles 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878] hfiles 2023-02-09 06:02:58,046 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,047 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:02:58,050 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f2/aeb772b23d2644f5aeb806a3ca8a070e as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e 2023-02-09 06:02:58,050 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,054 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f2/a4362535ab5b4b178879fe67b8501fc2 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2 2023-02-09 06:02:58,055 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. completed. 2023-02-09 06:02:58,055 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:58,055 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:02:58,055 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:58,055 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. started... 2023-02-09 06:02:58,057 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ade1186b313ff778b76c80d8ab0915ae 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:58,065 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:02:58,066 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d77ed01555a6aa928eaf72551d4179de in 578ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,066 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d77ed01555a6aa928eaf72551d4179de: 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856] hfiles 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e] hfiles 2023-02-09 06:02:58,067 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,073 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,076 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. completed. 2023-02-09 06:02:58,077 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:58,077 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:58,077 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:02:58,077 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. started... 2023-02-09 06:02:58,078 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4d26fbb2c4c0d8680c922798bd27af0b in 492ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,078 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c8ad95cd507414518521fd4735f22057 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:02:58,078 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4d26fbb2c4c0d8680c922798bd27af0b: 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291] hfiles 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2] hfiles 2023-02-09 06:02:58,079 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,098 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. completed. 2023-02-09 06:02:58,098 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:58,098 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:02:58,098 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. started... 2023-02-09 06:02:58,098 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. completed. 2023-02-09 06:02:58,099 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:02:58,099 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 768d94cc6e8029a7fb8e5393029b630d: 2023-02-09 06:02:58,100 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,100 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,100 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:02:58,100 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:02:58,101 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f1/9ecd4e1e0928454eb3a078f515249dcc 2023-02-09 06:02:58,108 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f1/e44e769c936c4e9d9a104e60147f8d3b 2023-02-09 06:02:58,138 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f2/eae638d6bc154e3dbc63638ee8f2efc0 2023-02-09 06:02:58,145 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f2/c1652d49e7b54dffaef0fc689499bd69 2023-02-09 06:02:58,148 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f1/9ecd4e1e0928454eb3a078f515249dcc as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc 2023-02-09 06:02:58,159 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f1/e44e769c936c4e9d9a104e60147f8d3b as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b 2023-02-09 06:02:58,160 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,162 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f2/eae638d6bc154e3dbc63638ee8f2efc0 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0 2023-02-09 06:02:58,172 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,173 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ade1186b313ff778b76c80d8ab0915ae in 116ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,173 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ade1186b313ff778b76c80d8ab0915ae: 2023-02-09 06:02:58,173 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc] hfiles 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0] hfiles 2023-02-09 06:02:58,174 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,175 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f2/c1652d49e7b54dffaef0fc689499bd69 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69 2023-02-09 06:02:58,194 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,195 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c8ad95cd507414518521fd4735f22057 in 117ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,195 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c8ad95cd507414518521fd4735f22057: 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b] hfiles 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69] hfiles 2023-02-09 06:02:58,196 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,209 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. completed. 2023-02-09 06:02:58,209 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:02:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:02:58,231 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. completed. 2023-02-09 06:02:58,231 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:02:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:02:58,394 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f2/f318580c41fa49bd910c8a08dc600ed8 2023-02-09 06:02:58,396 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 2023-02-09 06:02:58,407 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f1/3e7722aa3e514b358710a9b5cef9689c as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c 2023-02-09 06:02:58,409 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f1/af0061f54a2a4327a2c0549877003e10 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10 2023-02-09 06:02:58,416 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,417 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,417 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f2/f318580c41fa49bd910c8a08dc600ed8 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8 2023-02-09 06:02:58,418 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 2023-02-09 06:02:58,425 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,427 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 26c4d47bb37328c6404c7d590e7f4f3a in 937ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,427 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 26c4d47bb37328c6404c7d590e7f4f3a: 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c] hfiles 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8] hfiles 2023-02-09 06:02:58,427 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,428 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 067d02b89b340f1c494ce1a92146ed89 in 940ms, sequenceid=5, compaction requested=false 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 067d02b89b340f1c494ce1a92146ed89: 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10] hfiles 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8] hfiles 2023-02-09 06:02:58,428 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 for snapshot=testWithMapReduceMultiRegion 2023-02-09 06:02:58,444 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. completed. 2023-02-09 06:02:58,444 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:58,444 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:02:58,447 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. completed. 2023-02-09 06:02:58,447 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:58,447 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:02:58,447 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:02:58,447 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,447 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 06:02:58,447 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37579,1675922571597' in zk 2023-02-09 06:02:58,453 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:02:58,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:02:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:02:58,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:02:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 06:02:58,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:02:58,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:02:58,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:02:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37579,1675922571597': 2023-02-09 06:02:58,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37579,1675922571597' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 06:02:58,515 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. completed. 2023-02-09 06:02:58,516 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 06:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45185,1675922571550' in zk 2023-02-09 06:02:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:02:58,518 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:02:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:02:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 06:02:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:02:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:02:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:02:58,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45185,1675922571550': 2023-02-09 06:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45185,1675922571550' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 06:02:58,523 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-09 06:02:58,523 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:02:58,523 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:02:58,523 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-09 06:02:58,524 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:02:58,526 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,526 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:02:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:02:58,526 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:02:58,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:58,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,528 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,528 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:02:58,531 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 06:02:58,531 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,540 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:02:58,540 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:58,540 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:58,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:02:58,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:02:58,542 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 06:02:58,544 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,544 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:02:58,545 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:02:58,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:02:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:58,545 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:02:58,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:02:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:02:58,545 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:02:58,545 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:02:58,545 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 06:02:58,545 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:02:58,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-09 06:02:58,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:02:58,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:58,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:02:58,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 06:02:58,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-09 06:02:58,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-09 06:02:58,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 06:02:58,664 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 06:02:58,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675922577413Consolidate snapshot: testWithMapReduceMultiRegion at 1675922578546 (+1133 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675922578546Writing data manifest for testWithMapReduceMultiRegion at 1675922578572 (+26 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675922578589 (+17 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675922578663 (+74 ms) 2023-02-09 06:02:58,665 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:02:58,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2510 sec 2023-02-09 06:02:59,542 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:02:59,542 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:59,542 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:59,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:02:59,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:02:59,544 INFO [Listener at localhost/45571] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:02:59,545 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:59,545 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:59,558 INFO [Listener at localhost/45571] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:02:59,573 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:02:59,647 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:59,648 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37579] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:59,766 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:02:59,781 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:02:59,781 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:02:59,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:02:59,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 06:02:59,791 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 06:02:59,791 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:02:59,791 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 06:02:59,791 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 06:02:59,792 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:02:59,792 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:02:59,794 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:02:59,794 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:59,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:02:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:02:59,794 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:02:59,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:02:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:02:59,794 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:02:59,794 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:59,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:02:59,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:02:59,795 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:02:59,795 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:02:59,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:02:59,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:02:59,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:02:59,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:02:59,796 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:02:59,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:02:59,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:02:59,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:02:59,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:02:59,800 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:02:59,800 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:02:59,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:02:59,809 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:02:59,809 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:02:59,809 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:02:59,810 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. started... 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. started... 2023-02-09 06:02:59,811 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. started... 2023-02-09 06:02:59,811 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ab569df1f165c28a5f897f3cd8a8bead 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:02:59,811 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5ab8cdcd9565266ef061196394896cab 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:02:59,811 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 067d02b89b340f1c494ce1a92146ed89 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:02:59,816 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:02:59,816 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. started... 2023-02-09 06:02:59,816 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:59,816 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. started... 2023-02-09 06:02:59,816 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:02:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:02:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:02:59,817 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7e63f587506e353275a955c0e7af4076: 2023-02-09 06:02:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:02:59,818 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:02:59,818 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:02:59,818 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d77ed01555a6aa928eaf72551d4179de 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:02:59,818 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. started... 2023-02-09 06:02:59,818 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:02:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:02:59,819 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 26c4d47bb37328c6404c7d590e7f4f3a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:02:59,818 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. started... 2023-02-09 06:02:59,819 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4d26fbb2c4c0d8680c922798bd27af0b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:02:59,905 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f1/9cdef57decad434a8defc88b3b7ea7d4 2023-02-09 06:02:59,908 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f1/a764b2f6f6da45b1a436e851db776563 2023-02-09 06:02:59,911 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f1/bb990b8406294d5aad7e85f45107dc4a 2023-02-09 06:02:59,911 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f1/61101962d35b4e56bbd43aeca57b5ebd 2023-02-09 06:02:59,913 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f1/3055bd43d4e54fa9ab0593a8ffe4c938 2023-02-09 06:02:59,915 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f1/09ad0704379e4db2b6ff41172aaba323 2023-02-09 06:02:59,931 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 06:02:59,976 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f2/8eafe924768e45c480c87e3f04bc4c40 2023-02-09 06:02:59,980 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f2/722914ae94b649379401803adb10f29d 2023-02-09 06:02:59,985 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f1/61101962d35b4e56bbd43aeca57b5ebd as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/61101962d35b4e56bbd43aeca57b5ebd 2023-02-09 06:02:59,992 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/61101962d35b4e56bbd43aeca57b5ebd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:02:59,992 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f1/a764b2f6f6da45b1a436e851db776563 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/a764b2f6f6da45b1a436e851db776563 2023-02-09 06:02:59,993 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/.tmp/f2/8eafe924768e45c480c87e3f04bc4c40 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/8eafe924768e45c480c87e3f04bc4c40 2023-02-09 06:02:59,997 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f2/8e0f9ad2142d49438546d384813adbce 2023-02-09 06:03:00,000 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8 2023-02-09 06:03:00,001 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/a764b2f6f6da45b1a436e851db776563, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,003 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/8eafe924768e45c480c87e3f04bc4c40, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,003 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f2/f58a561c56f94ea592eb0f9b0d621a4f 2023-02-09 06:03:00,004 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4d26fbb2c4c0d8680c922798bd27af0b in 185ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,005 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4d26fbb2c4c0d8680c922798bd27af0b: 2023-02-09 06:03:00,005 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:00,005 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,005 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:00,005 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. started... 2023-02-09 06:03:00,005 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ade1186b313ff778b76c80d8ab0915ae 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:00,005 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f2/bd3ab3f27dbf422a9e9aae5192b0de25 2023-02-09 06:03:00,007 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/.tmp/f2/722914ae94b649379401803adb10f29d as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/722914ae94b649379401803adb10f29d 2023-02-09 06:03:00,013 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f1/3055bd43d4e54fa9ab0593a8ffe4c938 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/3055bd43d4e54fa9ab0593a8ffe4c938 2023-02-09 06:03:00,020 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f1/9cdef57decad434a8defc88b3b7ea7d4 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/9cdef57decad434a8defc88b3b7ea7d4 2023-02-09 06:03:00,022 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f1/bb990b8406294d5aad7e85f45107dc4a as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/bb990b8406294d5aad7e85f45107dc4a 2023-02-09 06:03:00,023 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f1/09ad0704379e4db2b6ff41172aaba323 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/09ad0704379e4db2b6ff41172aaba323 2023-02-09 06:03:00,025 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/3055bd43d4e54fa9ab0593a8ffe4c938, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:00,027 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/722914ae94b649379401803adb10f29d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,027 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/.tmp/f2/8e0f9ad2142d49438546d384813adbce as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/8e0f9ad2142d49438546d384813adbce 2023-02-09 06:03:00,028 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 26c4d47bb37328c6404c7d590e7f4f3a in 210ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,028 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 26c4d47bb37328c6404c7d590e7f4f3a: 2023-02-09 06:03:00,028 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:00,029 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:03:00,029 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,029 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. started... 2023-02-09 06:03:00,029 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c8ad95cd507414518521fd4735f22057 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:00,038 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/9cdef57decad434a8defc88b3b7ea7d4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,041 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/bb990b8406294d5aad7e85f45107dc4a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:00,042 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/.tmp/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8 2023-02-09 06:03:00,042 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/.tmp/f2/bd3ab3f27dbf422a9e9aae5192b0de25 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/bd3ab3f27dbf422a9e9aae5192b0de25 2023-02-09 06:03:00,048 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/09ad0704379e4db2b6ff41172aaba323, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,049 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/.tmp/f2/f58a561c56f94ea592eb0f9b0d621a4f as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/f58a561c56f94ea592eb0f9b0d621a4f 2023-02-09 06:03:00,050 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 06:03:00,052 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 06:03:00,056 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/bd3ab3f27dbf422a9e9aae5192b0de25, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:00,057 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/8e0f9ad2142d49438546d384813adbce, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:00,058 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5ab8cdcd9565266ef061196394896cab in 247ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,058 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5ab8cdcd9565266ef061196394896cab: 2023-02-09 06:03:00,058 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d77ed01555a6aa928eaf72551d4179de in 242ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,058 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:00,058 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d77ed01555a6aa928eaf72551d4179de: 2023-02-09 06:03:00,058 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,059 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:00,059 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. started... 2023-02-09 06:03:00,058 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:00,059 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 768d94cc6e8029a7fb8e5393029b630d: 2023-02-09 06:03:00,059 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:00,059 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,059 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:00,071 WARN [DataStreamer for file /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f1/d2f27f78863b46b9bb67359745ac9659] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-09 06:03:00,072 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,072 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f1/d2f27f78863b46b9bb67359745ac9659 2023-02-09 06:03:00,072 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/f58a561c56f94ea592eb0f9b0d621a4f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,073 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ab569df1f165c28a5f897f3cd8a8bead in 262ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,073 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ab569df1f165c28a5f897f3cd8a8bead: 2023-02-09 06:03:00,073 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:00,074 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 067d02b89b340f1c494ce1a92146ed89 in 263ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,074 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 067d02b89b340f1c494ce1a92146ed89: 2023-02-09 06:03:00,074 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:00,074 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:00,081 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f1/64550c0a5a5e4abeb3472b0ef998e64e 2023-02-09 06:03:00,108 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f2/54108455927a4bdcacc2cfec8ccffaea 2023-02-09 06:03:00,116 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f1/d2f27f78863b46b9bb67359745ac9659 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/d2f27f78863b46b9bb67359745ac9659 2023-02-09 06:03:00,120 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f2/e56d41255e054aa992334ea6cf541b81 2023-02-09 06:03:00,123 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/d2f27f78863b46b9bb67359745ac9659, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,124 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/.tmp/f2/54108455927a4bdcacc2cfec8ccffaea as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/54108455927a4bdcacc2cfec8ccffaea 2023-02-09 06:03:00,127 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f1/64550c0a5a5e4abeb3472b0ef998e64e as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/64550c0a5a5e4abeb3472b0ef998e64e 2023-02-09 06:03:00,132 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/54108455927a4bdcacc2cfec8ccffaea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,133 INFO [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ade1186b313ff778b76c80d8ab0915ae in 128ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,133 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ade1186b313ff778b76c80d8ab0915ae: 2023-02-09 06:03:00,133 DEBUG [rs(jenkins-hbase4.apache.org,37579,1675922571597)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,133 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:00,133 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:00,133 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/64550c0a5a5e4abeb3472b0ef998e64e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,134 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,134 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:00,134 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37579,1675922571597' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:00,135 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/.tmp/f2/e56d41255e054aa992334ea6cf541b81 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/e56d41255e054aa992334ea6cf541b81 2023-02-09 06:03:00,137 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,137 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:00,137 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,137 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37579,1675922571597' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 06:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c0353a2[Count = 1] remaining members to acquire global barrier 2023-02-09 06:03:00,142 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/e56d41255e054aa992334ea6cf541b81, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:00,143 INFO [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c8ad95cd507414518521fd4735f22057 in 114ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:00,143 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c8ad95cd507414518521fd4735f22057: 2023-02-09 06:03:00,143 DEBUG [rs(jenkins-hbase4.apache.org,45185,1675922571550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45185,1675922571550' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,149 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,150 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:00,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45185,1675922571550' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 06:03:00,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c0353a2[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:00,152 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 06:03:00,152 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,154 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37579,1675922571597' in zk 2023-02-09 06:03:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45185,1675922571550' in zk 2023-02-09 06:03:00,155 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,155 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:00,157 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:00,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:00,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,45185,1675922571550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:00,158 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:00,158 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,158 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:00,158 DEBUG [member: 'jenkins-hbase4.apache.org,37579,1675922571597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:00,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:00,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45185,1675922571550': 2023-02-09 06:03:00,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45185,1675922571550' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 06:03:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37579,1675922571597': 2023-02-09 06:03:00,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37579,1675922571597' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 06:03:00,168 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 06:03:00,168 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:00,168 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:00,168 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 06:03:00,168 INFO [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:00,171 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:00,172 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:00,172 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,172 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,173 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:00,176 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:00,176 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:00,183 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:00,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:00,184 DEBUG [(jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:00,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 06:03:00,182 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:00,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:00,187 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:00,188 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:00,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:00,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:00,288 DEBUG [Listener at localhost/45571] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:00,288 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:00,289 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:00,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:00,394 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop-2701052403394886564.jar 2023-02-09 06:03:00,412 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675922577354 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:00,413 DEBUG [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce 2023-02-09 06:03:00,414 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:00,414 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:00,414 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:00,414 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:00,414 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(239): region to add: ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=5ab8cdcd9565266ef061196394896cab as 5ab8cdcd9565266ef061196394896cab in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=d77ed01555a6aa928eaf72551d4179de as d77ed01555a6aa928eaf72551d4179de in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=ab569df1f165c28a5f897f3cd8a8bead as ab569df1f165c28a5f897f3cd8a8bead in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=067d02b89b340f1c494ce1a92146ed89 as 067d02b89b340f1c494ce1a92146ed89 in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=26c4d47bb37328c6404c7d590e7f4f3a as 26c4d47bb37328c6404c7d590e7f4f3a in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=c8ad95cd507414518521fd4735f22057 as c8ad95cd507414518521fd4735f22057 in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,415 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=7e63f587506e353275a955c0e7af4076 as 7e63f587506e353275a955c0e7af4076 in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,416 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=768d94cc6e8029a7fb8e5393029b630d as 768d94cc6e8029a7fb8e5393029b630d in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,416 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=4d26fbb2c4c0d8680c922798bd27af0b as 4d26fbb2c4c0d8680c922798bd27af0b in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,416 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(585): clone region=ade1186b313ff778b76c80d8ab0915ae as ade1186b313ff778b76c80d8ab0915ae in snapshot testWithMapReduceMultiRegion 2023-02-09 06:03:00,421 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => d77ed01555a6aa928eaf72551d4179de, NAME => 'testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,421 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c8ad95cd507414518521fd4735f22057, NAME => 'testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,421 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 067d02b89b340f1c494ce1a92146ed89, NAME => 'testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,421 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => ab569df1f165c28a5f897f3cd8a8bead, NAME => 'testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,421 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ab8cdcd9565266ef061196394896cab, NAME => 'testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,422 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 7e63f587506e353275a955c0e7af4076, NAME => 'testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,422 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 26c4d47bb37328c6404c7d590e7f4f3a, NAME => 'testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,423 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 768d94cc6e8029a7fb8e5393029b630d, NAME => 'testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,451 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,452 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 7e63f587506e353275a955c0e7af4076, disabling compactions & flushes 2023-02-09 06:03:00,452 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:00,452 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:00,452 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. after waiting 0 ms 2023-02-09 06:03:00,452 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:00,452 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:00,452 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 7e63f587506e353275a955c0e7af4076: Waiting for close lock at 1675922580452Disabling compacts and flushes for region at 1675922580452Disabling writes for close at 1675922580452Writing region close event to WAL at 1675922580452Closed at 1675922580452 2023-02-09 06:03:00,453 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 4d26fbb2c4c0d8680c922798bd27af0b, NAME => 'testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,456 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,456 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af0061f54a2a4327a2c0549877003e10 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,464 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,464 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e44e769c936c4e9d9a104e60147f8d3b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,468 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,468 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8925f1deb61749d389170bcfb9d6490b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,470 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91d8165d2d3d4abb8c55a5bf4a1d31a8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,484 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,484 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,485 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 58bf63816844457aa9979d98956210db from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 768d94cc6e8029a7fb8e5393029b630d, disabling compactions & flushes 2023-02-09 06:03:00,485 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. after waiting 0 ms 2023-02-09 06:03:00,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,485 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:00,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 768d94cc6e8029a7fb8e5393029b630d: Waiting for close lock at 1675922580485Disabling compacts and flushes for region at 1675922580485Disabling writes for close at 1675922580485Writing region close event to WAL at 1675922580485Closed at 1675922580485 2023-02-09 06:03:00,486 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ade1186b313ff778b76c80d8ab0915ae, NAME => 'testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,488 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,488 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e7722aa3e514b358710a9b5cef9689c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,496 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,496 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 791f392dc07840299d59f822eba17856 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,497 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 067d02b89b340f1c494ce1a92146ed89, disabling compactions & flushes 2023-02-09 06:03:00,497 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:00,497 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:00,497 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. after waiting 0 ms 2023-02-09 06:03:00,497 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:00,497 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:00,497 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 067d02b89b340f1c494ce1a92146ed89: Waiting for close lock at 1675922580497Disabling compacts and flushes for region at 1675922580497Disabling writes for close at 1675922580497Writing region close event to WAL at 1675922580497Closed at 1675922580497 2023-02-09 06:03:00,500 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c77ecb6155254bceb60ce8c57f571a41 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,500 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c1652d49e7b54dffaef0fc689499bd69 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,501 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,501 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 76e5147164454f75b44d5cb1ba89f291 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,507 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b72ee1a008354381a9cf770a69c76878 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,507 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f318580c41fa49bd910c8a08dc600ed8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c8ad95cd507414518521fd4735f22057, disabling compactions & flushes 2023-02-09 06:03:00,508 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,508 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aeb772b23d2644f5aeb806a3ca8a070e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing ab569df1f165c28a5f897f3cd8a8bead, disabling compactions & flushes 2023-02-09 06:03:00,508 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:00,508 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a4362535ab5b4b178879fe67b8501fc2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. after waiting 0 ms 2023-02-09 06:03:00,509 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,509 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:00,509 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c8ad95cd507414518521fd4735f22057: Waiting for close lock at 1675922580508Disabling compacts and flushes for region at 1675922580508Disabling writes for close at 1675922580509 (+1 ms)Writing region close event to WAL at 1675922580509Closed at 1675922580509 2023-02-09 06:03:00,508 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. after waiting 0 ms 2023-02-09 06:03:00,509 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:00,509 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:00,509 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for ab569df1f165c28a5f897f3cd8a8bead: Waiting for close lock at 1675922580508Disabling compacts and flushes for region at 1675922580508Disabling writes for close at 1675922580509 (+1 ms)Writing region close event to WAL at 1675922580509Closed at 1675922580509 2023-02-09 06:03:00,511 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5ab8cdcd9565266ef061196394896cab, disabling compactions & flushes 2023-02-09 06:03:00,511 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:00,511 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:00,511 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. after waiting 0 ms 2023-02-09 06:03:00,511 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:00,511 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:00,511 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5ab8cdcd9565266ef061196394896cab: Waiting for close lock at 1675922580511Disabling compacts and flushes for region at 1675922580511Disabling writes for close at 1675922580511Writing region close event to WAL at 1675922580511Closed at 1675922580511 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 26c4d47bb37328c6404c7d590e7f4f3a, disabling compactions & flushes 2023-02-09 06:03:00,512 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 4d26fbb2c4c0d8680c922798bd27af0b, disabling compactions & flushes 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing d77ed01555a6aa928eaf72551d4179de, disabling compactions & flushes 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:00,512 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:00,512 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. after waiting 0 ms 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:00,513 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. after waiting 0 ms 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:00,513 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for d77ed01555a6aa928eaf72551d4179de: Waiting for close lock at 1675922580512Disabling compacts and flushes for region at 1675922580512Disabling writes for close at 1675922580513 (+1 ms)Writing region close event to WAL at 1675922580513Closed at 1675922580513 2023-02-09 06:03:00,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. after waiting 0 ms 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 4d26fbb2c4c0d8680c922798bd27af0b: Waiting for close lock at 1675922580512Disabling compacts and flushes for region at 1675922580512Disabling writes for close at 1675922580513 (+1 ms)Writing region close event to WAL at 1675922580513Closed at 1675922580513 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:00,513 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:00,513 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 26c4d47bb37328c6404c7d590e7f4f3a: Waiting for close lock at 1675922580512Disabling compacts and flushes for region at 1675922580512Disabling writes for close at 1675922580513 (+1 ms)Writing region close event to WAL at 1675922580513Closed at 1675922580513 2023-02-09 06:03:00,514 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:00,514 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ecd4e1e0928454eb3a078f515249dcc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,516 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eae638d6bc154e3dbc63638ee8f2efc0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 06:03:00,519 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ade1186b313ff778b76c80d8ab0915ae, disabling compactions & flushes 2023-02-09 06:03:00,519 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,519 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,519 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. after waiting 0 ms 2023-02-09 06:03:00,519 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,519 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:00,519 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ade1186b313ff778b76c80d8ab0915ae: Waiting for close lock at 1675922580519Disabling compacts and flushes for region at 1675922580519Disabling writes for close at 1675922580519Writing region close event to WAL at 1675922580519Closed at 1675922580519 2023-02-09 06:03:00,519 INFO [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675922577354 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:00,520 DEBUG [Listener at localhost/45571] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,520 DEBUG [Listener at localhost/45571] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df 2023-02-09 06:03:00,521 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:00,521 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:00,522 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 06:03:00,522 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------067d02b89b340f1c494ce1a92146ed89/ 2023-02-09 06:03:00,523 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,523 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,524 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=067d02b89b340f1c494ce1a92146ed89-af0061f54a2a4327a2c0549877003e10 2023-02-09 06:03:00,524 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,524 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=067d02b89b340f1c494ce1a92146ed89-91d8165d2d3d4abb8c55a5bf4a1d31a8 2023-02-09 06:03:00,525 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------26c4d47bb37328c6404c7d590e7f4f3a/ 2023-02-09 06:03:00,525 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,525 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,526 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=26c4d47bb37328c6404c7d590e7f4f3a-3e7722aa3e514b358710a9b5cef9689c 2023-02-09 06:03:00,526 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,527 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=26c4d47bb37328c6404c7d590e7f4f3a-f318580c41fa49bd910c8a08dc600ed8 2023-02-09 06:03:00,527 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------4d26fbb2c4c0d8680c922798bd27af0b/ 2023-02-09 06:03:00,527 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,527 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,528 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=4d26fbb2c4c0d8680c922798bd27af0b-76e5147164454f75b44d5cb1ba89f291 2023-02-09 06:03:00,528 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,529 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=4d26fbb2c4c0d8680c922798bd27af0b-a4362535ab5b4b178879fe67b8501fc2 2023-02-09 06:03:00,529 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------5ab8cdcd9565266ef061196394896cab/ 2023-02-09 06:03:00,529 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,529 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,530 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=5ab8cdcd9565266ef061196394896cab-8925f1deb61749d389170bcfb9d6490b 2023-02-09 06:03:00,530 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,530 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=5ab8cdcd9565266ef061196394896cab-b72ee1a008354381a9cf770a69c76878 2023-02-09 06:03:00,531 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------768d94cc6e8029a7fb8e5393029b630d/ 2023-02-09 06:03:00,531 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,531 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------7e63f587506e353275a955c0e7af4076/ 2023-02-09 06:03:00,532 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,532 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------ab569df1f165c28a5f897f3cd8a8bead/ 2023-02-09 06:03:00,533 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,533 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,533 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=ab569df1f165c28a5f897f3cd8a8bead-58bf63816844457aa9979d98956210db 2023-02-09 06:03:00,533 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,534 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=ab569df1f165c28a5f897f3cd8a8bead-c77ecb6155254bceb60ce8c57f571a41 2023-02-09 06:03:00,534 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------ade1186b313ff778b76c80d8ab0915ae/ 2023-02-09 06:03:00,535 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,535 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,535 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=ade1186b313ff778b76c80d8ab0915ae-9ecd4e1e0928454eb3a078f515249dcc 2023-02-09 06:03:00,535 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,536 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=ade1186b313ff778b76c80d8ab0915ae-eae638d6bc154e3dbc63638ee8f2efc0 2023-02-09 06:03:00,536 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------c8ad95cd507414518521fd4735f22057/ 2023-02-09 06:03:00,537 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,537 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,538 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=c8ad95cd507414518521fd4735f22057-e44e769c936c4e9d9a104e60147f8d3b 2023-02-09 06:03:00,538 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,538 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=c8ad95cd507414518521fd4735f22057-c1652d49e7b54dffaef0fc689499bd69 2023-02-09 06:03:00,538 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |----------d77ed01555a6aa928eaf72551d4179de/ 2023-02-09 06:03:00,539 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:00,539 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:00,540 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=d77ed01555a6aa928eaf72551d4179de-791f392dc07840299d59f822eba17856 2023-02-09 06:03:00,540 DEBUG [Listener at localhost/45571] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:00,540 DEBUG [Listener at localhost/45571] util.CommonFSUtils(702): |----------------testWithMapReduce=d77ed01555a6aa928eaf72551d4179de-aeb772b23d2644f5aeb806a3ca8a070e 2023-02-09 06:03:00,549 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,549 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,550 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,550 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:00,550 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,550 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 06:03:00,551 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,551 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,551 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,620 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop-5855110796307946501.jar 2023-02-09 06:03:00,621 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,621 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,622 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,622 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,623 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,623 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,623 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 06:03:00,624 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 06:03:00,624 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 06:03:00,625 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 06:03:00,625 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 06:03:00,626 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 06:03:00,626 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 06:03:00,627 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 06:03:00,627 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 06:03:00,628 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 06:03:00,633 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:00,634 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:00,634 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:00,635 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:00,635 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:00,703 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop-8165045624452306463.jar 2023-02-09 06:03:00,704 DEBUG [Listener at localhost/45571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:00,754 WARN [Listener at localhost/45571] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 06:03:00,816 INFO [Listener at localhost/45571] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 06:03:01,159 WARN [Listener at localhost/45571] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/mapreduce.cluster.local.dir/1675922581068/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 06:03:01,160 WARN [Listener at localhost/45571] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/mapreduce.cluster.local.dir/1675922581068/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 06:03:01,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,437 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,439 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,441 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:01,442 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1 2023-02-09 06:03:01,443 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26c4d47bb37328c6404c7d590e7f4f3a columnFamilyName f1 2023-02-09 06:03:01,459 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/testWithMapReduce=26c4d47bb37328c6404c7d590e7f4f3a-3e7722aa3e514b358710a9b5cef9689c 2023-02-09 06:03:01,459 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(310): Store=26c4d47bb37328c6404c7d590e7f4f3a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,460 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:01,461 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2 2023-02-09 06:03:01,461 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26c4d47bb37328c6404c7d590e7f4f3a columnFamilyName f2 2023-02-09 06:03:01,467 DEBUG [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/testWithMapReduce=26c4d47bb37328c6404c7d590e7f4f3a-f318580c41fa49bd910c8a08dc600ed8 2023-02-09 06:03:01,468 INFO [StoreOpener-26c4d47bb37328c6404c7d590e7f4f3a-1] regionserver.HStore(310): Store=26c4d47bb37328c6404c7d590e7f4f3a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,468 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 26c4d47bb37328c6404c7d590e7f4f3a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70594756, jitterRate=0.051943838596343994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 26c4d47bb37328c6404c7d590e7f4f3a: Writing region info on filesystem at 1675922581439Initializing all the Stores at 1675922581440 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581440Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581441 (+1 ms)Region opened successfully at 1675922581468 (+27 ms) 2023-02-09 06:03:01,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 26c4d47bb37328c6404c7d590e7f4f3a, disabling compactions & flushes 2023-02-09 06:03:01,624 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:01,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:01,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. after waiting 0 ms 2023-02-09 06:03:01,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:01,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:01,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 26c4d47bb37328c6404c7d590e7f4f3a: Waiting for close lock at 1675922581624Disabling compacts and flushes for region at 1675922581624Disabling writes for close at 1675922581624Writing region close event to WAL at 1675922581629 (+5 ms)Closed at 1675922581629 2023-02-09 06:03:01,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,645 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,647 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,649 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:01,651 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f1 2023-02-09 06:03:01,651 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e63f587506e353275a955c0e7af4076 columnFamilyName f1 2023-02-09 06:03:01,652 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(310): Store=7e63f587506e353275a955c0e7af4076/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,652 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:01,654 DEBUG [StoreOpener-7e63f587506e353275a955c0e7af4076-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f2 2023-02-09 06:03:01,654 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e63f587506e353275a955c0e7af4076 columnFamilyName f2 2023-02-09 06:03:01,655 INFO [StoreOpener-7e63f587506e353275a955c0e7af4076-1] regionserver.HStore(310): Store=7e63f587506e353275a955c0e7af4076/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,656 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7e63f587506e353275a955c0e7af4076; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61153226, jitterRate=-0.08874592185020447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7e63f587506e353275a955c0e7af4076: Writing region info on filesystem at 1675922581647Initializing all the Stores at 1675922581648 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581648Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581648Region opened successfully at 1675922581656 (+8 ms) 2023-02-09 06:03:01,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7e63f587506e353275a955c0e7af4076, disabling compactions & flushes 2023-02-09 06:03:01,674 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:01,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:01,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. after waiting 0 ms 2023-02-09 06:03:01,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:01,675 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:01,675 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7e63f587506e353275a955c0e7af4076: Waiting for close lock at 1675922581674Disabling compacts and flushes for region at 1675922581674Disabling writes for close at 1675922581674Writing region close event to WAL at 1675922581675 (+1 ms)Closed at 1675922581675 2023-02-09 06:03:01,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,681 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,682 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,684 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:01,686 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f1 2023-02-09 06:03:01,686 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 768d94cc6e8029a7fb8e5393029b630d columnFamilyName f1 2023-02-09 06:03:01,687 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(310): Store=768d94cc6e8029a7fb8e5393029b630d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,687 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:01,689 DEBUG [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f2 2023-02-09 06:03:01,690 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 768d94cc6e8029a7fb8e5393029b630d columnFamilyName f2 2023-02-09 06:03:01,690 INFO [StoreOpener-768d94cc6e8029a7fb8e5393029b630d-1] regionserver.HStore(310): Store=768d94cc6e8029a7fb8e5393029b630d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,691 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,691 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 768d94cc6e8029a7fb8e5393029b630d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68031321, jitterRate=0.013745680451393127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,691 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 768d94cc6e8029a7fb8e5393029b630d: Writing region info on filesystem at 1675922581682Initializing all the Stores at 1675922581683 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581684 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581684Region opened successfully at 1675922581691 (+7 ms) 2023-02-09 06:03:01,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 768d94cc6e8029a7fb8e5393029b630d, disabling compactions & flushes 2023-02-09 06:03:01,712 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:01,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:01,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. after waiting 0 ms 2023-02-09 06:03:01,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:01,713 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:01,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 768d94cc6e8029a7fb8e5393029b630d: Waiting for close lock at 1675922581712Disabling compacts and flushes for region at 1675922581712Disabling writes for close at 1675922581712Writing region close event to WAL at 1675922581713 (+1 ms)Closed at 1675922581713 2023-02-09 06:03:01,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,719 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,723 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,725 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:01,726 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1 2023-02-09 06:03:01,727 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ade1186b313ff778b76c80d8ab0915ae columnFamilyName f1 2023-02-09 06:03:01,734 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/testWithMapReduce=ade1186b313ff778b76c80d8ab0915ae-9ecd4e1e0928454eb3a078f515249dcc 2023-02-09 06:03:01,735 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(310): Store=ade1186b313ff778b76c80d8ab0915ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,735 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:01,736 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2 2023-02-09 06:03:01,736 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ade1186b313ff778b76c80d8ab0915ae columnFamilyName f2 2023-02-09 06:03:01,748 DEBUG [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/testWithMapReduce=ade1186b313ff778b76c80d8ab0915ae-eae638d6bc154e3dbc63638ee8f2efc0 2023-02-09 06:03:01,748 INFO [StoreOpener-ade1186b313ff778b76c80d8ab0915ae-1] regionserver.HStore(310): Store=ade1186b313ff778b76c80d8ab0915ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,748 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,749 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ade1186b313ff778b76c80d8ab0915ae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70065549, jitterRate=0.04405803978443146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ade1186b313ff778b76c80d8ab0915ae: Writing region info on filesystem at 1675922581723Initializing all the Stores at 1675922581724 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581724Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581725 (+1 ms)Region opened successfully at 1675922581749 (+24 ms) 2023-02-09 06:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ade1186b313ff778b76c80d8ab0915ae, disabling compactions & flushes 2023-02-09 06:03:01,793 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. after waiting 0 ms 2023-02-09 06:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:01,796 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:01,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ade1186b313ff778b76c80d8ab0915ae: Waiting for close lock at 1675922581793Disabling compacts and flushes for region at 1675922581793Disabling writes for close at 1675922581793Writing region close event to WAL at 1675922581796 (+3 ms)Closed at 1675922581796 2023-02-09 06:03:01,804 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,805 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,806 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,808 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:01,809 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1 2023-02-09 06:03:01,810 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d26fbb2c4c0d8680c922798bd27af0b columnFamilyName f1 2023-02-09 06:03:01,817 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/testWithMapReduce=4d26fbb2c4c0d8680c922798bd27af0b-76e5147164454f75b44d5cb1ba89f291 2023-02-09 06:03:01,817 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(310): Store=4d26fbb2c4c0d8680c922798bd27af0b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,817 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:01,819 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2 2023-02-09 06:03:01,819 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d26fbb2c4c0d8680c922798bd27af0b columnFamilyName f2 2023-02-09 06:03:01,830 DEBUG [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/testWithMapReduce=4d26fbb2c4c0d8680c922798bd27af0b-a4362535ab5b4b178879fe67b8501fc2 2023-02-09 06:03:01,830 INFO [StoreOpener-4d26fbb2c4c0d8680c922798bd27af0b-1] regionserver.HStore(310): Store=4d26fbb2c4c0d8680c922798bd27af0b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,831 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4d26fbb2c4c0d8680c922798bd27af0b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63986534, jitterRate=-0.04652634263038635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4d26fbb2c4c0d8680c922798bd27af0b: Writing region info on filesystem at 1675922581806Initializing all the Stores at 1675922581807 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581807Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581807Region opened successfully at 1675922581831 (+24 ms) 2023-02-09 06:03:01,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4d26fbb2c4c0d8680c922798bd27af0b, disabling compactions & flushes 2023-02-09 06:03:01,900 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:01,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:01,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. after waiting 0 ms 2023-02-09 06:03:01,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:01,907 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:01,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4d26fbb2c4c0d8680c922798bd27af0b: Waiting for close lock at 1675922581900Disabling compacts and flushes for region at 1675922581900Disabling writes for close at 1675922581901 (+1 ms)Writing region close event to WAL at 1675922581907 (+6 ms)Closed at 1675922581907 2023-02-09 06:03:01,913 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,913 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,924 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,927 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:01,928 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1 2023-02-09 06:03:01,929 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067d02b89b340f1c494ce1a92146ed89 columnFamilyName f1 2023-02-09 06:03:01,936 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/testWithMapReduce=067d02b89b340f1c494ce1a92146ed89-af0061f54a2a4327a2c0549877003e10 2023-02-09 06:03:01,936 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(310): Store=067d02b89b340f1c494ce1a92146ed89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,936 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:01,937 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2 2023-02-09 06:03:01,938 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067d02b89b340f1c494ce1a92146ed89 columnFamilyName f2 2023-02-09 06:03:01,944 DEBUG [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/testWithMapReduce=067d02b89b340f1c494ce1a92146ed89-91d8165d2d3d4abb8c55a5bf4a1d31a8 2023-02-09 06:03:01,944 INFO [StoreOpener-067d02b89b340f1c494ce1a92146ed89-1] regionserver.HStore(310): Store=067d02b89b340f1c494ce1a92146ed89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:01,944 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:01,944 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 067d02b89b340f1c494ce1a92146ed89; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69139477, jitterRate=0.03025849163532257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:01,944 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 067d02b89b340f1c494ce1a92146ed89: Writing region info on filesystem at 1675922581924Initializing all the Stores at 1675922581926 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581926Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581926Region opened successfully at 1675922581944 (+18 ms) 2023-02-09 06:03:01,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 067d02b89b340f1c494ce1a92146ed89, disabling compactions & flushes 2023-02-09 06:03:01,986 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:01,986 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:01,986 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. after waiting 0 ms 2023-02-09 06:03:01,986 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:01,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:01,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 067d02b89b340f1c494ce1a92146ed89: Waiting for close lock at 1675922581985Disabling compacts and flushes for region at 1675922581985Disabling writes for close at 1675922581986 (+1 ms)Writing region close event to WAL at 1675922581989 (+3 ms)Closed at 1675922581989 2023-02-09 06:03:01,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:01,994 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:01,995 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:01,997 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:01,998 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1 2023-02-09 06:03:01,999 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab8cdcd9565266ef061196394896cab columnFamilyName f1 2023-02-09 06:03:02,005 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/testWithMapReduce=5ab8cdcd9565266ef061196394896cab-8925f1deb61749d389170bcfb9d6490b 2023-02-09 06:03:02,006 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(310): Store=5ab8cdcd9565266ef061196394896cab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,006 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:02,007 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2 2023-02-09 06:03:02,007 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab8cdcd9565266ef061196394896cab columnFamilyName f2 2023-02-09 06:03:02,014 DEBUG [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/testWithMapReduce=5ab8cdcd9565266ef061196394896cab-b72ee1a008354381a9cf770a69c76878 2023-02-09 06:03:02,014 INFO [StoreOpener-5ab8cdcd9565266ef061196394896cab-1] regionserver.HStore(310): Store=5ab8cdcd9565266ef061196394896cab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,014 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:02,014 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5ab8cdcd9565266ef061196394896cab; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72122182, jitterRate=0.07470425963401794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:02,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5ab8cdcd9565266ef061196394896cab: Writing region info on filesystem at 1675922581995Initializing all the Stores at 1675922581996 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581996Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922581997 (+1 ms)Region opened successfully at 1675922582015 (+18 ms) 2023-02-09 06:03:02,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5ab8cdcd9565266ef061196394896cab, disabling compactions & flushes 2023-02-09 06:03:02,053 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:02,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:02,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. after waiting 0 ms 2023-02-09 06:03:02,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:02,065 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:02,066 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5ab8cdcd9565266ef061196394896cab: Waiting for close lock at 1675922582053Disabling compacts and flushes for region at 1675922582053Disabling writes for close at 1675922582053Writing region close event to WAL at 1675922582065 (+12 ms)Closed at 1675922582065 2023-02-09 06:03:02,070 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:02,070 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:02,077 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:02,080 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:02,081 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1 2023-02-09 06:03:02,081 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8ad95cd507414518521fd4735f22057 columnFamilyName f1 2023-02-09 06:03:02,088 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/testWithMapReduce=c8ad95cd507414518521fd4735f22057-e44e769c936c4e9d9a104e60147f8d3b 2023-02-09 06:03:02,088 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(310): Store=c8ad95cd507414518521fd4735f22057/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,089 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:02,090 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2 2023-02-09 06:03:02,090 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8ad95cd507414518521fd4735f22057 columnFamilyName f2 2023-02-09 06:03:02,102 DEBUG [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/testWithMapReduce=c8ad95cd507414518521fd4735f22057-c1652d49e7b54dffaef0fc689499bd69 2023-02-09 06:03:02,102 INFO [StoreOpener-c8ad95cd507414518521fd4735f22057-1] regionserver.HStore(310): Store=c8ad95cd507414518521fd4735f22057/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:02,103 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c8ad95cd507414518521fd4735f22057; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65003774, jitterRate=-0.03136828541755676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:02,103 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c8ad95cd507414518521fd4735f22057: Writing region info on filesystem at 1675922582077Initializing all the Stores at 1675922582078 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582079 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582079Region opened successfully at 1675922582103 (+24 ms) 2023-02-09 06:03:02,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c8ad95cd507414518521fd4735f22057, disabling compactions & flushes 2023-02-09 06:03:02,140 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:02,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:02,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. after waiting 0 ms 2023-02-09 06:03:02,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:02,145 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:02,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c8ad95cd507414518521fd4735f22057: Waiting for close lock at 1675922582140Disabling compacts and flushes for region at 1675922582140Disabling writes for close at 1675922582141 (+1 ms)Writing region close event to WAL at 1675922582145 (+4 ms)Closed at 1675922582145 2023-02-09 06:03:02,151 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:02,151 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:02,155 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:02,161 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:02,163 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1 2023-02-09 06:03:02,164 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77ed01555a6aa928eaf72551d4179de columnFamilyName f1 2023-02-09 06:03:02,187 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/testWithMapReduce=d77ed01555a6aa928eaf72551d4179de-791f392dc07840299d59f822eba17856 2023-02-09 06:03:02,188 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(310): Store=d77ed01555a6aa928eaf72551d4179de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,188 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:02,189 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2 2023-02-09 06:03:02,189 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77ed01555a6aa928eaf72551d4179de columnFamilyName f2 2023-02-09 06:03:02,197 DEBUG [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/testWithMapReduce=d77ed01555a6aa928eaf72551d4179de-aeb772b23d2644f5aeb806a3ca8a070e 2023-02-09 06:03:02,197 INFO [StoreOpener-d77ed01555a6aa928eaf72551d4179de-1] regionserver.HStore(310): Store=d77ed01555a6aa928eaf72551d4179de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:02,198 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d77ed01555a6aa928eaf72551d4179de; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62020254, jitterRate=-0.07582619786262512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:02,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d77ed01555a6aa928eaf72551d4179de: Writing region info on filesystem at 1675922582155Initializing all the Stores at 1675922582157 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582157Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582160 (+3 ms)Region opened successfully at 1675922582198 (+38 ms) 2023-02-09 06:03:02,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d77ed01555a6aa928eaf72551d4179de, disabling compactions & flushes 2023-02-09 06:03:02,235 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:02,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:02,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. after waiting 0 ms 2023-02-09 06:03:02,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:02,238 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:02,239 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d77ed01555a6aa928eaf72551d4179de: Waiting for close lock at 1675922582235Disabling compacts and flushes for region at 1675922582235Disabling writes for close at 1675922582236 (+1 ms)Writing region close event to WAL at 1675922582238 (+2 ms)Closed at 1675922582238 2023-02-09 06:03:02,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:02,242 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:02,244 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:02,248 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:02,249 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1 2023-02-09 06:03:02,250 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab569df1f165c28a5f897f3cd8a8bead columnFamilyName f1 2023-02-09 06:03:02,258 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/testWithMapReduce=ab569df1f165c28a5f897f3cd8a8bead-58bf63816844457aa9979d98956210db 2023-02-09 06:03:02,258 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(310): Store=ab569df1f165c28a5f897f3cd8a8bead/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,258 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:02,259 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2 2023-02-09 06:03:02,259 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab569df1f165c28a5f897f3cd8a8bead columnFamilyName f2 2023-02-09 06:03:02,267 DEBUG [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(539): loaded hdfs://localhost:44871/user/jenkins/test-data/1b40efbb-8d3c-a737-ae3d-163b1d21308f/testWithMapReduceMultiRegion/eba621a5-058c-4338-ab3a-b130650f20df/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/testWithMapReduce=ab569df1f165c28a5f897f3cd8a8bead-c77ecb6155254bceb60ce8c57f571a41 2023-02-09 06:03:02,268 INFO [StoreOpener-ab569df1f165c28a5f897f3cd8a8bead-1] regionserver.HStore(310): Store=ab569df1f165c28a5f897f3cd8a8bead/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:02,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:02,268 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ab569df1f165c28a5f897f3cd8a8bead; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71885439, jitterRate=0.07117651402950287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:02,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ab569df1f165c28a5f897f3cd8a8bead: Writing region info on filesystem at 1675922582244Initializing all the Stores at 1675922582245 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582245Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922582248 (+3 ms)Region opened successfully at 1675922582268 (+20 ms) 2023-02-09 06:03:02,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ab569df1f165c28a5f897f3cd8a8bead, disabling compactions & flushes 2023-02-09 06:03:02,311 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:02,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:02,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. after waiting 0 ms 2023-02-09 06:03:02,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:02,317 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:02,317 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ab569df1f165c28a5f897f3cd8a8bead: Waiting for close lock at 1675922582311Disabling compacts and flushes for region at 1675922582311Disabling writes for close at 1675922582311Writing region close event to WAL at 1675922582317 (+6 ms)Closed at 1675922582317 2023-02-09 06:03:03,288 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,288 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-09 06:03:03,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-09 06:03:03,299 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,299 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,300 INFO [Listener at localhost/45571] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 06:03:03,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 06:03:03,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 06:03:03,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922583313"}]},"ts":"1675922583313"} 2023-02-09 06:03:03,313 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,313 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:03,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 06:03:03,318 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 06:03:03,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, UNASSIGN}] 2023-02-09 06:03:03,324 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, UNASSIGN 2023-02-09 06:03:03,325 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, UNASSIGN 2023-02-09 06:03:03,325 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, UNASSIGN 2023-02-09 06:03:03,325 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, UNASSIGN 2023-02-09 06:03:03,325 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, UNASSIGN 2023-02-09 06:03:03,327 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5ab8cdcd9565266ef061196394896cab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:03,327 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=26c4d47bb37328c6404c7d590e7f4f3a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:03,327 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=c8ad95cd507414518521fd4735f22057, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:03,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ade1186b313ff778b76c80d8ab0915ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:03,327 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583326"}]},"ts":"1675922583326"} 2023-02-09 06:03:03,327 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583326"}]},"ts":"1675922583326"} 2023-02-09 06:03:03,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583326"}]},"ts":"1675922583326"} 2023-02-09 06:03:03,327 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583326"}]},"ts":"1675922583326"} 2023-02-09 06:03:03,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e63f587506e353275a955c0e7af4076, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:03,327 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922583327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583327"}]},"ts":"1675922583327"} 2023-02-09 06:03:03,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure c8ad95cd507414518521fd4735f22057, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:03:03,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure 26c4d47bb37328c6404c7d590e7f4f3a, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:03:03,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure ade1186b313ff778b76c80d8ab0915ae, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:03:03,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 5ab8cdcd9565266ef061196394896cab, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:03:03,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 7e63f587506e353275a955c0e7af4076, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:03:03,342 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, UNASSIGN 2023-02-09 06:03:03,343 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, UNASSIGN 2023-02-09 06:03:03,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, UNASSIGN 2023-02-09 06:03:03,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, UNASSIGN 2023-02-09 06:03:03,343 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, UNASSIGN 2023-02-09 06:03:03,344 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4d26fbb2c4c0d8680c922798bd27af0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:03,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583344"}]},"ts":"1675922583344"} 2023-02-09 06:03:03,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab569df1f165c28a5f897f3cd8a8bead, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:03,345 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d77ed01555a6aa928eaf72551d4179de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:03,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=768d94cc6e8029a7fb8e5393029b630d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:03,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=067d02b89b340f1c494ce1a92146ed89, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:03,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583344"}]},"ts":"1675922583344"} 2023-02-09 06:03:03,345 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922583344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583344"}]},"ts":"1675922583344"} 2023-02-09 06:03:03,345 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583344"}]},"ts":"1675922583344"} 2023-02-09 06:03:03,345 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922583344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922583344"}]},"ts":"1675922583344"} 2023-02-09 06:03:03,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 4d26fbb2c4c0d8680c922798bd27af0b, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:03:03,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure ab569df1f165c28a5f897f3cd8a8bead, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:03:03,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=34, state=RUNNABLE; CloseRegionProcedure 768d94cc6e8029a7fb8e5393029b630d, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:03:03,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=36, state=RUNNABLE; CloseRegionProcedure 067d02b89b340f1c494ce1a92146ed89, server=jenkins-hbase4.apache.org,37579,1675922571597}] 2023-02-09 06:03:03,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=35, state=RUNNABLE; CloseRegionProcedure d77ed01555a6aa928eaf72551d4179de, server=jenkins-hbase4.apache.org,45185,1675922571550}] 2023-02-09 06:03:03,416 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,416 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:03,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:03,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:03,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5ab8cdcd9565266ef061196394896cab, disabling compactions & flushes 2023-02-09 06:03:03,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ade1186b313ff778b76c80d8ab0915ae, disabling compactions & flushes 2023-02-09 06:03:03,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:03,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. after waiting 0 ms 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. after waiting 0 ms 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:03,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab. 2023-02-09 06:03:03,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5ab8cdcd9565266ef061196394896cab: Waiting for close lock at 1675922583495Running coprocessor pre-close hooks at 1675922583495Disabling compacts and flushes for region at 1675922583495Disabling writes for close at 1675922583496 (+1 ms)Writing region close event to WAL at 1675922583504 (+8 ms)Running coprocessor post-close hooks at 1675922583512 (+8 ms)Closed at 1675922583513 (+1 ms) 2023-02-09 06:03:03,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae. 2023-02-09 06:03:03,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ade1186b313ff778b76c80d8ab0915ae: Waiting for close lock at 1675922583495Running coprocessor pre-close hooks at 1675922583495Disabling compacts and flushes for region at 1675922583495Disabling writes for close at 1675922583496 (+1 ms)Writing region close event to WAL at 1675922583504 (+8 ms)Running coprocessor post-close hooks at 1675922583513 (+9 ms)Closed at 1675922583514 (+1 ms) 2023-02-09 06:03:03,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:03,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 26c4d47bb37328c6404c7d590e7f4f3a, disabling compactions & flushes 2023-02-09 06:03:03,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. after waiting 0 ms 2023-02-09 06:03:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:03,517 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5ab8cdcd9565266ef061196394896cab, regionState=CLOSED 2023-02-09 06:03:03,517 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583517"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583517"}]},"ts":"1675922583517"} 2023-02-09 06:03:03,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:03,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:03,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7e63f587506e353275a955c0e7af4076, disabling compactions & flushes 2023-02-09 06:03:03,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:03,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:03,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. after waiting 0 ms 2023-02-09 06:03:03,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:03,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ade1186b313ff778b76c80d8ab0915ae, regionState=CLOSED 2023-02-09 06:03:03,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583518"}]},"ts":"1675922583518"} 2023-02-09 06:03:03,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-09 06:03:03,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 5ab8cdcd9565266ef061196394896cab, server=jenkins-hbase4.apache.org,45185,1675922571550 in 185 msec 2023-02-09 06:03:03,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:03,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076. 2023-02-09 06:03:03,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7e63f587506e353275a955c0e7af4076: Waiting for close lock at 1675922583518Running coprocessor pre-close hooks at 1675922583518Disabling compacts and flushes for region at 1675922583518Disabling writes for close at 1675922583518Writing region close event to WAL at 1675922583519 (+1 ms)Running coprocessor post-close hooks at 1675922583527 (+8 ms)Closed at 1675922583528 (+1 ms) 2023-02-09 06:03:03,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a. 2023-02-09 06:03:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 26c4d47bb37328c6404c7d590e7f4f3a: Waiting for close lock at 1675922583516Running coprocessor pre-close hooks at 1675922583516Disabling compacts and flushes for region at 1675922583516Disabling writes for close at 1675922583516Writing region close event to WAL at 1675922583523 (+7 ms)Running coprocessor post-close hooks at 1675922583529 (+6 ms)Closed at 1675922583530 (+1 ms) 2023-02-09 06:03:03,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-09 06:03:03,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure ade1186b313ff778b76c80d8ab0915ae, server=jenkins-hbase4.apache.org,37579,1675922571597 in 187 msec 2023-02-09 06:03:03,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:03,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:03,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d26fbb2c4c0d8680c922798bd27af0b, disabling compactions & flushes 2023-02-09 06:03:03,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5ab8cdcd9565266ef061196394896cab, UNASSIGN in 203 msec 2023-02-09 06:03:03,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:03,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:03,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. after waiting 0 ms 2023-02-09 06:03:03,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:03,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e63f587506e353275a955c0e7af4076, regionState=CLOSED 2023-02-09 06:03:03,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922583533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583533"}]},"ts":"1675922583533"} 2023-02-09 06:03:03,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:03,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ade1186b313ff778b76c80d8ab0915ae, UNASSIGN in 211 msec 2023-02-09 06:03:03,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:03,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d77ed01555a6aa928eaf72551d4179de, disabling compactions & flushes 2023-02-09 06:03:03,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:03,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:03,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. after waiting 0 ms 2023-02-09 06:03:03,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:03,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=26c4d47bb37328c6404c7d590e7f4f3a, regionState=CLOSED 2023-02-09 06:03:03,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583535"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583535"}]},"ts":"1675922583535"} 2023-02-09 06:03:03,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de. 2023-02-09 06:03:03,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d77ed01555a6aa928eaf72551d4179de: Waiting for close lock at 1675922583535Running coprocessor pre-close hooks at 1675922583535Disabling compacts and flushes for region at 1675922583535Disabling writes for close at 1675922583535Writing region close event to WAL at 1675922583543 (+8 ms)Running coprocessor post-close hooks at 1675922583549 (+6 ms)Closed at 1675922583549 2023-02-09 06:03:03,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b. 2023-02-09 06:03:03,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d26fbb2c4c0d8680c922798bd27af0b: Waiting for close lock at 1675922583532Running coprocessor pre-close hooks at 1675922583532Disabling compacts and flushes for region at 1675922583532Disabling writes for close at 1675922583533 (+1 ms)Writing region close event to WAL at 1675922583540 (+7 ms)Running coprocessor post-close hooks at 1675922583551 (+11 ms)Closed at 1675922583552 (+1 ms) 2023-02-09 06:03:03,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 06:03:03,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 7e63f587506e353275a955c0e7af4076, server=jenkins-hbase4.apache.org,37579,1675922571597 in 198 msec 2023-02-09 06:03:03,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:03,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:03,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 768d94cc6e8029a7fb8e5393029b630d, disabling compactions & flushes 2023-02-09 06:03:03,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:03,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:03,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. after waiting 0 ms 2023-02-09 06:03:03,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-09 06:03:03,554 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d77ed01555a6aa928eaf72551d4179de, regionState=CLOSED 2023-02-09 06:03:03,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure 26c4d47bb37328c6404c7d590e7f4f3a, server=jenkins-hbase4.apache.org,45185,1675922571550 in 209 msec 2023-02-09 06:03:03,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:03,554 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583554"}]},"ts":"1675922583554"} 2023-02-09 06:03:03,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:03,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:03,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 067d02b89b340f1c494ce1a92146ed89, disabling compactions & flushes 2023-02-09 06:03:03,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. after waiting 0 ms 2023-02-09 06:03:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:03,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e63f587506e353275a955c0e7af4076, UNASSIGN in 231 msec 2023-02-09 06:03:03,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4d26fbb2c4c0d8680c922798bd27af0b, regionState=CLOSED 2023-02-09 06:03:03,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583557"}]},"ts":"1675922583557"} 2023-02-09 06:03:03,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=26c4d47bb37328c6404c7d590e7f4f3a, UNASSIGN in 234 msec 2023-02-09 06:03:03,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=35 2023-02-09 06:03:03,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=35, state=SUCCESS; CloseRegionProcedure d77ed01555a6aa928eaf72551d4179de, server=jenkins-hbase4.apache.org,45185,1675922571550 in 207 msec 2023-02-09 06:03:03,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-09 06:03:03,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d77ed01555a6aa928eaf72551d4179de, UNASSIGN in 240 msec 2023-02-09 06:03:03,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 4d26fbb2c4c0d8680c922798bd27af0b, server=jenkins-hbase4.apache.org,37579,1675922571597 in 213 msec 2023-02-09 06:03:03,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d26fbb2c4c0d8680c922798bd27af0b, UNASSIGN in 242 msec 2023-02-09 06:03:03,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:03,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89. 2023-02-09 06:03:03,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d. 2023-02-09 06:03:03,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 067d02b89b340f1c494ce1a92146ed89: Waiting for close lock at 1675922583555Running coprocessor pre-close hooks at 1675922583555Disabling compacts and flushes for region at 1675922583555Disabling writes for close at 1675922583556 (+1 ms)Writing region close event to WAL at 1675922583566 (+10 ms)Running coprocessor post-close hooks at 1675922583571 (+5 ms)Closed at 1675922583571 2023-02-09 06:03:03,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 768d94cc6e8029a7fb8e5393029b630d: Waiting for close lock at 1675922583554Running coprocessor pre-close hooks at 1675922583554Disabling compacts and flushes for region at 1675922583554Disabling writes for close at 1675922583554Writing region close event to WAL at 1675922583564 (+10 ms)Running coprocessor post-close hooks at 1675922583571 (+7 ms)Closed at 1675922583571 2023-02-09 06:03:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c8ad95cd507414518521fd4735f22057, disabling compactions & flushes 2023-02-09 06:03:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. after waiting 0 ms 2023-02-09 06:03:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:03,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=768d94cc6e8029a7fb8e5393029b630d, regionState=CLOSED 2023-02-09 06:03:03,575 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922583575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583575"}]},"ts":"1675922583575"} 2023-02-09 06:03:03,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:03,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:03,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ab569df1f165c28a5f897f3cd8a8bead, disabling compactions & flushes 2023-02-09 06:03:03,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:03,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:03,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. after waiting 0 ms 2023-02-09 06:03:03,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:03,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=067d02b89b340f1c494ce1a92146ed89, regionState=CLOSED 2023-02-09 06:03:03,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583577"}]},"ts":"1675922583577"} 2023-02-09 06:03:03,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=34 2023-02-09 06:03:03,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=34, state=SUCCESS; CloseRegionProcedure 768d94cc6e8029a7fb8e5393029b630d, server=jenkins-hbase4.apache.org,45185,1675922571550 in 229 msec 2023-02-09 06:03:03,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=36 2023-02-09 06:03:03,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=36, state=SUCCESS; CloseRegionProcedure 067d02b89b340f1c494ce1a92146ed89, server=jenkins-hbase4.apache.org,37579,1675922571597 in 231 msec 2023-02-09 06:03:03,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=768d94cc6e8029a7fb8e5393029b630d, UNASSIGN in 261 msec 2023-02-09 06:03:03,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=067d02b89b340f1c494ce1a92146ed89, UNASSIGN in 263 msec 2023-02-09 06:03:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead. 2023-02-09 06:03:03,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ab569df1f165c28a5f897f3cd8a8bead: Waiting for close lock at 1675922583576Running coprocessor pre-close hooks at 1675922583576Disabling compacts and flushes for region at 1675922583576Disabling writes for close at 1675922583576Writing region close event to WAL at 1675922583590 (+14 ms)Running coprocessor post-close hooks at 1675922583595 (+5 ms)Closed at 1675922583596 (+1 ms) 2023-02-09 06:03:03,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:03,599 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab569df1f165c28a5f897f3cd8a8bead, regionState=CLOSED 2023-02-09 06:03:03,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583599"}]},"ts":"1675922583599"} 2023-02-09 06:03:03,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-09 06:03:03,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure ab569df1f165c28a5f897f3cd8a8bead, server=jenkins-hbase4.apache.org,37579,1675922571597 in 255 msec 2023-02-09 06:03:03,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ab569df1f165c28a5f897f3cd8a8bead, UNASSIGN in 284 msec 2023-02-09 06:03:03,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:03,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057. 2023-02-09 06:03:03,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c8ad95cd507414518521fd4735f22057: Waiting for close lock at 1675922583574Running coprocessor pre-close hooks at 1675922583574Disabling compacts and flushes for region at 1675922583574Disabling writes for close at 1675922583574Writing region close event to WAL at 1675922583608 (+34 ms)Running coprocessor post-close hooks at 1675922583613 (+5 ms)Closed at 1675922583614 (+1 ms) 2023-02-09 06:03:03,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:03,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=c8ad95cd507414518521fd4735f22057, regionState=CLOSED 2023-02-09 06:03:03,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922583617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922583617"}]},"ts":"1675922583617"} 2023-02-09 06:03:03,618 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,618 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:03,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-09 06:03:03,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure c8ad95cd507414518521fd4735f22057, server=jenkins-hbase4.apache.org,45185,1675922571550 in 286 msec 2023-02-09 06:03:03,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-09 06:03:03,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c8ad95cd507414518521fd4735f22057, UNASSIGN in 301 msec 2023-02-09 06:03:03,624 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922583624"}]},"ts":"1675922583624"} 2023-02-09 06:03:03,625 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 06:03:03,627 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 06:03:03,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 326 msec 2023-02-09 06:03:03,920 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,920 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:03,922 INFO [Listener at localhost/45571] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-09 06:03:03,923 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,923 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 06:03:03,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:03,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:03,939 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:03,939 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:03,939 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:03,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:03,954 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:03,960 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/recovered.edits] 2023-02-09 06:03:03,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/recovered.edits] 2023-02-09 06:03:03,960 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/recovered.edits] 2023-02-09 06:03:03,960 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/recovered.edits] 2023-02-09 06:03:03,960 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/recovered.edits] 2023-02-09 06:03:03,961 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/recovered.edits] 2023-02-09 06:03:03,961 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/recovered.edits] 2023-02-09 06:03:03,961 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/recovered.edits] 2023-02-09 06:03:03,974 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/9ecd4e1e0928454eb3a078f515249dcc 2023-02-09 06:03:03,974 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/3055bd43d4e54fa9ab0593a8ffe4c938 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/3055bd43d4e54fa9ab0593a8ffe4c938 2023-02-09 06:03:03,974 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/64550c0a5a5e4abeb3472b0ef998e64e to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/64550c0a5a5e4abeb3472b0ef998e64e 2023-02-09 06:03:03,976 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/3e7722aa3e514b358710a9b5cef9689c 2023-02-09 06:03:03,976 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/09ad0704379e4db2b6ff41172aaba323 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/09ad0704379e4db2b6ff41172aaba323 2023-02-09 06:03:03,981 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/61101962d35b4e56bbd43aeca57b5ebd to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/61101962d35b4e56bbd43aeca57b5ebd 2023-02-09 06:03:03,981 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/58bf63816844457aa9979d98956210db 2023-02-09 06:03:03,985 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f1/af0061f54a2a4327a2c0549877003e10 2023-02-09 06:03:03,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f1/791f392dc07840299d59f822eba17856 2023-02-09 06:03:03,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/d2f27f78863b46b9bb67359745ac9659 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f1/d2f27f78863b46b9bb67359745ac9659 2023-02-09 06:03:03,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f1/e44e769c936c4e9d9a104e60147f8d3b 2023-02-09 06:03:03,986 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f1/76e5147164454f75b44d5cb1ba89f291 2023-02-09 06:03:03,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/9cdef57decad434a8defc88b3b7ea7d4 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f1/9cdef57decad434a8defc88b3b7ea7d4 2023-02-09 06:03:03,989 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/recovered.edits/6.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d/recovered.edits/6.seqid 2023-02-09 06:03:03,989 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/a764b2f6f6da45b1a436e851db776563 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f1/a764b2f6f6da45b1a436e851db776563 2023-02-09 06:03:03,990 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/768d94cc6e8029a7fb8e5393029b630d 2023-02-09 06:03:03,990 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:03,995 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/91d8165d2d3d4abb8c55a5bf4a1d31a8 2023-02-09 06:03:03,996 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/54108455927a4bdcacc2cfec8ccffaea to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/54108455927a4bdcacc2cfec8ccffaea 2023-02-09 06:03:03,996 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/8e0f9ad2142d49438546d384813adbce to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/8e0f9ad2142d49438546d384813adbce 2023-02-09 06:03:03,997 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/recovered.edits] 2023-02-09 06:03:03,998 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/8eafe924768e45c480c87e3f04bc4c40 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/8eafe924768e45c480c87e3f04bc4c40 2023-02-09 06:03:03,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/bc0bbe02c0f34ec9bc62fcdf4c48eeb8 2023-02-09 06:03:03,999 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/c1652d49e7b54dffaef0fc689499bd69 2023-02-09 06:03:04,000 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/f58a561c56f94ea592eb0f9b0d621a4f to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/f2/f58a561c56f94ea592eb0f9b0d621a4f 2023-02-09 06:03:04,002 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/f2/aeb772b23d2644f5aeb806a3ca8a070e 2023-02-09 06:03:04,003 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/f2/eae638d6bc154e3dbc63638ee8f2efc0 2023-02-09 06:03:04,003 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/722914ae94b649379401803adb10f29d to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/722914ae94b649379401803adb10f29d 2023-02-09 06:03:04,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/f2/c77ecb6155254bceb60ce8c57f571a41 2023-02-09 06:03:04,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/f2/a4362535ab5b4b178879fe67b8501fc2 2023-02-09 06:03:04,005 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/e56d41255e054aa992334ea6cf541b81 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/f2/e56d41255e054aa992334ea6cf541b81 2023-02-09 06:03:04,009 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/f2/f318580c41fa49bd910c8a08dc600ed8 2023-02-09 06:03:04,011 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/8925f1deb61749d389170bcfb9d6490b 2023-02-09 06:03:04,012 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89/recovered.edits/12.seqid 2023-02-09 06:03:04,013 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae/recovered.edits/12.seqid 2023-02-09 06:03:04,013 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de/recovered.edits/12.seqid 2023-02-09 06:03:04,014 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead/recovered.edits/12.seqid 2023-02-09 06:03:04,014 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/bb990b8406294d5aad7e85f45107dc4a to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f1/bb990b8406294d5aad7e85f45107dc4a 2023-02-09 06:03:04,015 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/067d02b89b340f1c494ce1a92146ed89 2023-02-09 06:03:04,015 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/d77ed01555a6aa928eaf72551d4179de 2023-02-09 06:03:04,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ade1186b313ff778b76c80d8ab0915ae 2023-02-09 06:03:04,015 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:04,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/ab569df1f165c28a5f897f3cd8a8bead 2023-02-09 06:03:04,017 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a/recovered.edits/12.seqid 2023-02-09 06:03:04,018 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/26c4d47bb37328c6404c7d590e7f4f3a 2023-02-09 06:03:04,018 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f1, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/f2, FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/recovered.edits] 2023-02-09 06:03:04,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057/recovered.edits/12.seqid 2023-02-09 06:03:04,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/c8ad95cd507414518521fd4735f22057 2023-02-09 06:03:04,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/b72ee1a008354381a9cf770a69c76878 2023-02-09 06:03:04,028 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b/recovered.edits/12.seqid 2023-02-09 06:03:04,030 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/4d26fbb2c4c0d8680c922798bd27af0b 2023-02-09 06:03:04,031 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/bd3ab3f27dbf422a9e9aae5192b0de25 to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/f2/bd3ab3f27dbf422a9e9aae5192b0de25 2023-02-09 06:03:04,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/recovered.edits/6.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076/recovered.edits/6.seqid 2023-02-09 06:03:04,038 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/recovered.edits/12.seqid to hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/archive/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab/recovered.edits/12.seqid 2023-02-09 06:03:04,039 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/7e63f587506e353275a955c0e7af4076 2023-02-09 06:03:04,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/.tmp/data/default/testWithMapReduce/5ab8cdcd9565266ef061196394896cab 2023-02-09 06:03:04,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 06:03:04,041 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:04,041 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:04,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 06:03:04,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:04,074 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-09 06:03:04,080 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675922575561.c8ad95cd507414518521fd4735f22057.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922584082"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,086 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 06:03:04,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 768d94cc6e8029a7fb8e5393029b630d, NAME => 'testWithMapReduce,,1675922575561.768d94cc6e8029a7fb8e5393029b630d.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => d77ed01555a6aa928eaf72551d4179de, NAME => 'testWithMapReduce,aaa,1675922575561.d77ed01555a6aa928eaf72551d4179de.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 067d02b89b340f1c494ce1a92146ed89, NAME => 'testWithMapReduce,d\x84\x84,1675922575561.067d02b89b340f1c494ce1a92146ed89.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => ab569df1f165c28a5f897f3cd8a8bead, NAME => 'testWithMapReduce,g\xA7\xA7,1675922575561.ab569df1f165c28a5f897f3cd8a8bead.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 4d26fbb2c4c0d8680c922798bd27af0b, NAME => 'testWithMapReduce,j\xCA\xCA,1675922575561.4d26fbb2c4c0d8680c922798bd27af0b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => c8ad95cd507414518521fd4735f22057, NAME => 'testWithMapReduce,m\xED\xED,1675922575561.c8ad95cd507414518521fd4735f22057.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 26c4d47bb37328c6404c7d590e7f4f3a, NAME => 'testWithMapReduce,q\x11\x10,1675922575561.26c4d47bb37328c6404c7d590e7f4f3a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => ade1186b313ff778b76c80d8ab0915ae, NAME => 'testWithMapReduce,t43,1675922575561.ade1186b313ff778b76c80d8ab0915ae.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 5ab8cdcd9565266ef061196394896cab, NAME => 'testWithMapReduce,wWV,1675922575561.5ab8cdcd9565266ef061196394896cab.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 7e63f587506e353275a955c0e7af4076, NAME => 'testWithMapReduce,zz{,1675922575561.7e63f587506e353275a955c0e7af4076.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 06:03:04,086 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 06:03:04,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922584086"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:04,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 06:03:04,095 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:04,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 166 msec 2023-02-09 06:03:04,243 INFO [Listener at localhost/45571] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:04,243 INFO [Listener at localhost/45571] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:04,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45807] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 06:03:04,245 INFO [Listener at localhost/45571] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-09 06:03:04,246 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:04,246 INFO [Listener at localhost/45571] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:04,246 DEBUG [Listener at localhost/45571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b8ae91a to 127.0.0.1:56060 2023-02-09 06:03:04,246 DEBUG [Listener at localhost/45571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,246 DEBUG [Listener at localhost/45571] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:04,246 DEBUG [Listener at localhost/45571] util.JVMClusterUtil(257): Found active master hash=387271118, stopped=false 2023-02-09 06:03:04,246 INFO [Listener at localhost/45571] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:03:04,250 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:04,250 INFO [Listener at localhost/45571] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:04,250 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:04,250 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:04,250 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:04,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:04,252 DEBUG [Listener at localhost/45571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b2b9bbe to 127.0.0.1:56060 2023-02-09 06:03:04,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:04,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:04,252 DEBUG [Listener at localhost/45571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,252 INFO [Listener at localhost/45571] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45185,1675922571550' ***** 2023-02-09 06:03:04,252 INFO [Listener at localhost/45571] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:04,252 INFO [Listener at localhost/45571] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37579,1675922571597' ***** 2023-02-09 06:03:04,252 INFO [Listener at localhost/45571] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:04,253 INFO [RS:0;jenkins-hbase4:45185] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:04,253 INFO [RS:1;jenkins-hbase4:37579] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:04,253 INFO [RS:0;jenkins-hbase4:45185] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:04,253 INFO [RS:1;jenkins-hbase4:37579] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:04,253 INFO [RS:0;jenkins-hbase4:45185] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:04,253 INFO [RS:1;jenkins-hbase4:37579] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:04,253 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:04,253 DEBUG [RS:0;jenkins-hbase4:45185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f5a54fc to 127.0.0.1:56060 2023-02-09 06:03:04,254 DEBUG [RS:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,254 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(3304): Received CLOSE for 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:03:04,254 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:04,254 DEBUG [RS:1;jenkins-hbase4:37579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10c45562 to 127.0.0.1:56060 2023-02-09 06:03:04,255 DEBUG [RS:1;jenkins-hbase4:37579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,255 INFO [RS:1;jenkins-hbase4:37579] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:04,255 INFO [RS:1;jenkins-hbase4:37579] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:04,255 INFO [RS:1;jenkins-hbase4:37579] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:04,256 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:04,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 267b5d2e66b3c39e3c2f122b5d5e6f57, disabling compactions & flushes 2023-02-09 06:03:04,256 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 06:03:04,255 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:04,255 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:04,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:04,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:04,255 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45185,1675922571550; all regions closed. 2023-02-09 06:03:04,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:04,256 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 267b5d2e66b3c39e3c2f122b5d5e6f57=hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57.} 2023-02-09 06:03:04,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:03:04,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:03:04,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. after waiting 0 ms 2023-02-09 06:03:04,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:03:04,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:04,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 267b5d2e66b3c39e3c2f122b5d5e6f57 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:04,261 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:04,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-09 06:03:04,262 DEBUG [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1505): Waiting on 1588230740, 267b5d2e66b3c39e3c2f122b5d5e6f57 2023-02-09 06:03:04,268 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:04,269 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:04,276 DEBUG [RS:0;jenkins-hbase4:45185] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs 2023-02-09 06:03:04,276 INFO [RS:0;jenkins-hbase4:45185] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45185%2C1675922571550:(num 1675922575027) 2023-02-09 06:03:04,277 DEBUG [RS:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,277 INFO [RS:0;jenkins-hbase4:45185] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:04,288 INFO [RS:0;jenkins-hbase4:45185] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:04,289 INFO [RS:0;jenkins-hbase4:45185] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:04,289 INFO [RS:0;jenkins-hbase4:45185] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:04,289 INFO [RS:0;jenkins-hbase4:45185] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:04,289 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:04,290 INFO [RS:0;jenkins-hbase4:45185] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45185 2023-02-09 06:03:04,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/.tmp/info/548329f5d13e4d60887f8e3cfb7bef74 2023-02-09 06:03:04,306 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:04,306 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:04,306 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45185,1675922571550 2023-02-09 06:03:04,306 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:04,306 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68781030 rejected from java.util.concurrent.ThreadPoolExecutor@6c4799e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,307 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:04,307 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30777efe rejected from java.util.concurrent.ThreadPoolExecutor@6c4799e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,308 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45185,1675922571550] 2023-02-09 06:03:04,308 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45185,1675922571550; numProcessing=1 2023-02-09 06:03:04,311 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45185,1675922571550 already deleted, retry=false 2023-02-09 06:03:04,311 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45185,1675922571550 expired; onlineServers=1 2023-02-09 06:03:04,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/info/9082f41434604623836b96a17b0c6a13 2023-02-09 06:03:04,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/.tmp/info/548329f5d13e4d60887f8e3cfb7bef74 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/info/548329f5d13e4d60887f8e3cfb7bef74 2023-02-09 06:03:04,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9082f41434604623836b96a17b0c6a13 2023-02-09 06:03:04,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/info/548329f5d13e4d60887f8e3cfb7bef74, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:04,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 267b5d2e66b3c39e3c2f122b5d5e6f57 in 68ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:04,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/namespace/267b5d2e66b3c39e3c2f122b5d5e6f57/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:04,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:03:04,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 267b5d2e66b3c39e3c2f122b5d5e6f57: Waiting for close lock at 1675922584254Running coprocessor pre-close hooks at 1675922584254Disabling compacts and flushes for region at 1675922584254Disabling writes for close at 1675922584260 (+6 ms)Obtaining lock to block concurrent updates at 1675922584261 (+1 ms)Preparing flush snapshotting stores in 267b5d2e66b3c39e3c2f122b5d5e6f57 at 1675922584261Finished memstore snapshotting hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922584261Flushing stores of hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. at 1675922584263 (+2 ms)Flushing 267b5d2e66b3c39e3c2f122b5d5e6f57/info: creating writer at 1675922584263Flushing 267b5d2e66b3c39e3c2f122b5d5e6f57/info: appending metadata at 1675922584273 (+10 ms)Flushing 267b5d2e66b3c39e3c2f122b5d5e6f57/info: closing flushed file at 1675922584273Flushing 267b5d2e66b3c39e3c2f122b5d5e6f57/info: reopening flushed file at 1675922584319 (+46 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 267b5d2e66b3c39e3c2f122b5d5e6f57 in 68ms, sequenceid=6, compaction requested=false at 1675922584329 (+10 ms)Writing region close event to WAL at 1675922584341 (+12 ms)Running coprocessor post-close hooks at 1675922584351 (+10 ms)Closed at 1675922584352 (+1 ms) 2023-02-09 06:03:04,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922574615.267b5d2e66b3c39e3c2f122b5d5e6f57. 2023-02-09 06:03:04,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/rep_barrier/0357ad012141453e87f34d981cecbc77 2023-02-09 06:03:04,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0357ad012141453e87f34d981cecbc77 2023-02-09 06:03:04,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/table/2d7bb07ab4e942d0803628ffa2d64f95 2023-02-09 06:03:04,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d7bb07ab4e942d0803628ffa2d64f95 2023-02-09 06:03:04,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/info/9082f41434604623836b96a17b0c6a13 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/info/9082f41434604623836b96a17b0c6a13 2023-02-09 06:03:04,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9082f41434604623836b96a17b0c6a13 2023-02-09 06:03:04,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/info/9082f41434604623836b96a17b0c6a13, entries=30, sequenceid=57, filesize=7.9 K 2023-02-09 06:03:04,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/rep_barrier/0357ad012141453e87f34d981cecbc77 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/rep_barrier/0357ad012141453e87f34d981cecbc77 2023-02-09 06:03:04,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0357ad012141453e87f34d981cecbc77 2023-02-09 06:03:04,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/rep_barrier/0357ad012141453e87f34d981cecbc77, entries=10, sequenceid=57, filesize=5.9 K 2023-02-09 06:03:04,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/.tmp/table/2d7bb07ab4e942d0803628ffa2d64f95 as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/table/2d7bb07ab4e942d0803628ffa2d64f95 2023-02-09 06:03:04,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d7bb07ab4e942d0803628ffa2d64f95 2023-02-09 06:03:04,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/table/2d7bb07ab4e942d0803628ffa2d64f95, entries=13, sequenceid=57, filesize=5.9 K 2023-02-09 06:03:04,403 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 142ms, sequenceid=57, compaction requested=false 2023-02-09 06:03:04,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 06:03:04,413 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:04,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:04,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922584256Running coprocessor pre-close hooks at 1675922584256Disabling compacts and flushes for region at 1675922584256Disabling writes for close at 1675922584261 (+5 ms)Obtaining lock to block concurrent updates at 1675922584261Preparing flush snapshotting stores in 1588230740 at 1675922584261Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675922584261Flushing stores of hbase:meta,,1.1588230740 at 1675922584263 (+2 ms)Flushing 1588230740/info: creating writer at 1675922584263Flushing 1588230740/info: appending metadata at 1675922584292 (+29 ms)Flushing 1588230740/info: closing flushed file at 1675922584292Flushing 1588230740/rep_barrier: creating writer at 1675922584324 (+32 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922584333 (+9 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922584333Flushing 1588230740/table: creating writer at 1675922584361 (+28 ms)Flushing 1588230740/table: appending metadata at 1675922584365 (+4 ms)Flushing 1588230740/table: closing flushed file at 1675922584365Flushing 1588230740/info: reopening flushed file at 1675922584382 (+17 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922584389 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675922584396 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 142ms, sequenceid=57, compaction requested=false at 1675922584403 (+7 ms)Writing region close event to WAL at 1675922584408 (+5 ms)Running coprocessor post-close hooks at 1675922584413 (+5 ms)Closed at 1675922584414 (+1 ms) 2023-02-09 06:03:04,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:04,449 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,449 INFO [RS:0;jenkins-hbase4:45185] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45185,1675922571550; zookeeper connection closed. 2023-02-09 06:03:04,449 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48fe2b12 rejected from java.util.concurrent.ThreadPoolExecutor@6c4799e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,450 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:45185-0x10037ace2d20001, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,450 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@78fb051f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@78fb051f 2023-02-09 06:03:04,450 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4261f219 rejected from java.util.concurrent.ThreadPoolExecutor@6c4799e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,462 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37579,1675922571597; all regions closed. 2023-02-09 06:03:04,469 DEBUG [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs 2023-02-09 06:03:04,469 INFO [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37579%2C1675922571597.meta:.meta(num 1675922574335) 2023-02-09 06:03:04,480 DEBUG [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/oldWALs 2023-02-09 06:03:04,480 INFO [RS:1;jenkins-hbase4:37579] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37579%2C1675922571597:(num 1675922575028) 2023-02-09 06:03:04,481 DEBUG [RS:1;jenkins-hbase4:37579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,481 INFO [RS:1;jenkins-hbase4:37579] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:04,481 INFO [RS:1;jenkins-hbase4:37579] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:04,483 INFO [RS:1;jenkins-hbase4:37579] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37579 2023-02-09 06:03:04,483 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:04,487 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:04,487 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37579,1675922571597 2023-02-09 06:03:04,488 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f5eab80 rejected from java.util.concurrent.ThreadPoolExecutor@2b613ab3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,488 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37579,1675922571597] 2023-02-09 06:03:04,488 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37579,1675922571597; numProcessing=2 2023-02-09 06:03:04,489 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37579,1675922571597 already deleted, retry=false 2023-02-09 06:03:04,490 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37579,1675922571597 expired; onlineServers=0 2023-02-09 06:03:04,490 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45807,1675922570397' ***** 2023-02-09 06:03:04,490 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:04,490 DEBUG [M:0;jenkins-hbase4:45807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@562843f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:04,490 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45807,1675922570397 2023-02-09 06:03:04,490 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45807,1675922570397; all regions closed. 2023-02-09 06:03:04,491 DEBUG [M:0;jenkins-hbase4:45807] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:04,491 DEBUG [M:0;jenkins-hbase4:45807] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:04,491 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:04,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922572834] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922572834,5,FailOnTimeoutGroup] 2023-02-09 06:03:04,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922572834] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922572834,5,FailOnTimeoutGroup] 2023-02-09 06:03:04,492 DEBUG [M:0;jenkins-hbase4:45807] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:04,494 INFO [M:0;jenkins-hbase4:45807] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:04,494 INFO [M:0;jenkins-hbase4:45807] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:04,494 INFO [M:0;jenkins-hbase4:45807] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:04,494 DEBUG [M:0;jenkins-hbase4:45807] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:04,494 INFO [M:0;jenkins-hbase4:45807] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:04,494 ERROR [M:0;jenkins-hbase4:45807] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:04,495 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] 2023-02-09 06:03:04,496 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-09 06:03:04,496 INFO [M:0;jenkins-hbase4:45807] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:04,496 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:04,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:04,497 DEBUG [M:0;jenkins-hbase4:45807] zookeeper.ZKUtil(398): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:04,497 WARN [M:0;jenkins-hbase4:45807] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:04,497 INFO [M:0;jenkins-hbase4:45807] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:04,498 INFO [M:0;jenkins-hbase4:45807] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:04,499 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:04,499 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:04,499 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:04,499 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:04,499 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:04,499 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.24 KB heapSize=192.16 KB 2023-02-09 06:03:04,519 INFO [M:0;jenkins-hbase4:45807] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.24 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fad63630e66346a2b317c53ab92c664f 2023-02-09 06:03:04,526 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fad63630e66346a2b317c53ab92c664f as hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fad63630e66346a2b317c53ab92c664f 2023-02-09 06:03:04,533 INFO [M:0;jenkins-hbase4:45807] regionserver.HStore(1080): Added hdfs://localhost:44871/user/jenkins/test-data/0b72b6c2-2968-9009-e0a7-ccd44714e1da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fad63630e66346a2b317c53ab92c664f, entries=53, sequenceid=357, filesize=10.4 K 2023-02-09 06:03:04,534 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegion(2947): Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=357, compaction requested=false 2023-02-09 06:03:04,536 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:04,536 DEBUG [M:0;jenkins-hbase4:45807] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922584498Disabling compacts and flushes for region at 1675922584498Disabling writes for close at 1675922584499 (+1 ms)Obtaining lock to block concurrent updates at 1675922584499Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922584499Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163064, getHeapSize=196752, getOffHeapSize=0, getCellsCount=442 at 1675922584499Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922584500 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922584501 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922584506 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922584506Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922584527 (+21 ms)Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=357, compaction requested=false at 1675922584534 (+7 ms)Writing region close event to WAL at 1675922584536 (+2 ms)Closed at 1675922584536 2023-02-09 06:03:04,541 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:04,541 INFO [M:0;jenkins-hbase4:45807] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:04,542 INFO [M:0;jenkins-hbase4:45807] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45807 2023-02-09 06:03:04,545 DEBUG [M:0;jenkins-hbase4:45807] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45807,1675922570397 already deleted, retry=false 2023-02-09 06:03:04,851 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,851 INFO [M:0;jenkins-hbase4:45807] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45807,1675922570397; zookeeper connection closed. 2023-02-09 06:03:04,852 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5dc10b18 rejected from java.util.concurrent.ThreadPoolExecutor@5fc09f70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,852 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): master:45807-0x10037ace2d20000, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,852 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ae8ca34 rejected from java.util.concurrent.ThreadPoolExecutor@5fc09f70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,952 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,952 INFO [RS:1;jenkins-hbase4:37579] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37579,1675922571597; zookeeper connection closed. 2023-02-09 06:03:04,952 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59fe2fd rejected from java.util.concurrent.ThreadPoolExecutor@2b613ab3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,952 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1705deee] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1705deee 2023-02-09 06:03:04,952 DEBUG [Listener at localhost/45571-EventThread] zookeeper.ZKWatcher(600): regionserver:37579-0x10037ace2d20002, quorum=127.0.0.1:56060, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:04,952 ERROR [Listener at localhost/45571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7dd1568c rejected from java.util.concurrent.ThreadPoolExecutor@2b613ab3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:04,952 INFO [Listener at localhost/45571] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:04,953 WARN [Listener at localhost/45571] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:04,958 INFO [Listener at localhost/45571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:05,063 WARN [BP-908078248-172.31.14.131-1675922567002 heartbeating to localhost/127.0.0.1:44871] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:05,063 WARN [BP-908078248-172.31.14.131-1675922567002 heartbeating to localhost/127.0.0.1:44871] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-908078248-172.31.14.131-1675922567002 (Datanode Uuid 02ec61e9-cec7-472e-96dc-f98f0afa8358) service to localhost/127.0.0.1:44871 2023-02-09 06:03:05,065 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/dfs/data/data3/current/BP-908078248-172.31.14.131-1675922567002] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:05,066 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/dfs/data/data4/current/BP-908078248-172.31.14.131-1675922567002] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:05,068 WARN [Listener at localhost/45571] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:05,086 INFO [Listener at localhost/45571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:05,189 WARN [BP-908078248-172.31.14.131-1675922567002 heartbeating to localhost/127.0.0.1:44871] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:05,189 WARN [BP-908078248-172.31.14.131-1675922567002 heartbeating to localhost/127.0.0.1:44871] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-908078248-172.31.14.131-1675922567002 (Datanode Uuid 9ccac1d8-3c48-4633-91b5-bf4d311f8cc9) service to localhost/127.0.0.1:44871 2023-02-09 06:03:05,190 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/dfs/data/data1/current/BP-908078248-172.31.14.131-1675922567002] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:05,190 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/cluster_a99f5eaa-4161-a875-4d86-26ac62b768ea/dfs/data/data2/current/BP-908078248-172.31.14.131-1675922567002] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:05,223 INFO [Listener at localhost/45571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:05,344 INFO [Listener at localhost/45571] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:05,420 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:05,437 INFO [Listener at localhost/45571] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44871 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: (jenkins-hbase4.apache.org,45807,1675922570397)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44871 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/45571 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44871 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44871 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44871 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44871 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@4ee3dfc1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44871 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=529 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 219) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3913 (was 4952) 2023-02-09 06:03:05,446 INFO [Listener at localhost/45571] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=529, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=166, AvailableMemoryMB=3914 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.log.dir so I do NOT create it in target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be 2023-02-09 06:03:05,458 WARN [Listener at localhost/45571] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.tmp.dir so I do NOT create it in target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be 2023-02-09 06:03:05,458 WARN [Listener at localhost/45571] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36ccfbd-5dbb-7700-c469-20ee82f7fd68/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:05,458 DEBUG [Listener at localhost/45571] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62, deleteOnExit=true 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:05,458 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/test.cache.data in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:05,459 DEBUG [Listener at localhost/45571] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:05,459 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:05,460 INFO [Listener at localhost/45571] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:05,465 WARN [Listener at localhost/45571] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:05,466 WARN [Listener at localhost/45571] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:05,517 WARN [Listener at localhost/45571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:05,519 INFO [Listener at localhost/45571] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:05,524 INFO [Listener at localhost/45571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/java.io.tmpdir/Jetty_localhost_38669_hdfs____ptziqm/webapp 2023-02-09 06:03:05,636 INFO [Listener at localhost/45571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38669 2023-02-09 06:03:05,640 WARN [Listener at localhost/45571] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:05,640 WARN [Listener at localhost/45571] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:05,686 WARN [Listener at localhost/41121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:05,703 WARN [Listener at localhost/41121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:05,706 WARN [Listener at localhost/41121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:05,707 INFO [Listener at localhost/41121] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:05,714 INFO [Listener at localhost/41121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/java.io.tmpdir/Jetty_localhost_41457_datanode____snit9c/webapp 2023-02-09 06:03:05,806 INFO [Listener at localhost/41121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41457 2023-02-09 06:03:05,819 WARN [Listener at localhost/40195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:05,850 WARN [Listener at localhost/40195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:05,861 WARN [Listener at localhost/40195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:05,863 INFO [Listener at localhost/40195] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:05,871 INFO [Listener at localhost/40195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/java.io.tmpdir/Jetty_localhost_40887_datanode____.ubi4wu/webapp 2023-02-09 06:03:05,946 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24403ffd025cb705: Processing first storage report for DS-d0ce5b83-3e43-4bb5-a747-298d92538f48 from datanode 3e9aebe2-8dde-47ca-9190-f1a69272ca9e 2023-02-09 06:03:05,947 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24403ffd025cb705: from storage DS-d0ce5b83-3e43-4bb5-a747-298d92538f48 node DatanodeRegistration(127.0.0.1:46771, datanodeUuid=3e9aebe2-8dde-47ca-9190-f1a69272ca9e, infoPort=33139, infoSecurePort=0, ipcPort=40195, storageInfo=lv=-57;cid=testClusterID;nsid=1445999257;c=1675922585469), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:05,947 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24403ffd025cb705: Processing first storage report for DS-014f6fad-d240-4866-aba3-d7f7eae947af from datanode 3e9aebe2-8dde-47ca-9190-f1a69272ca9e 2023-02-09 06:03:05,947 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24403ffd025cb705: from storage DS-014f6fad-d240-4866-aba3-d7f7eae947af node DatanodeRegistration(127.0.0.1:46771, datanodeUuid=3e9aebe2-8dde-47ca-9190-f1a69272ca9e, infoPort=33139, infoSecurePort=0, ipcPort=40195, storageInfo=lv=-57;cid=testClusterID;nsid=1445999257;c=1675922585469), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:05,977 INFO [Listener at localhost/40195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40887 2023-02-09 06:03:05,992 WARN [Listener at localhost/34951] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:06,118 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34e5cd77ddc7673f: Processing first storage report for DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d from datanode cda5d7b4-f377-4472-bce8-3defa47cf549 2023-02-09 06:03:06,118 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34e5cd77ddc7673f: from storage DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d node DatanodeRegistration(127.0.0.1:39049, datanodeUuid=cda5d7b4-f377-4472-bce8-3defa47cf549, infoPort=43533, infoSecurePort=0, ipcPort=34951, storageInfo=lv=-57;cid=testClusterID;nsid=1445999257;c=1675922585469), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:06,118 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34e5cd77ddc7673f: Processing first storage report for DS-fd7d5151-ee7b-49e0-be2f-ed98d709c17c from datanode cda5d7b4-f377-4472-bce8-3defa47cf549 2023-02-09 06:03:06,118 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34e5cd77ddc7673f: from storage DS-fd7d5151-ee7b-49e0-be2f-ed98d709c17c node DatanodeRegistration(127.0.0.1:39049, datanodeUuid=cda5d7b4-f377-4472-bce8-3defa47cf549, infoPort=43533, infoSecurePort=0, ipcPort=34951, storageInfo=lv=-57;cid=testClusterID;nsid=1445999257;c=1675922585469), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:06,211 DEBUG [Listener at localhost/34951] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be 2023-02-09 06:03:06,216 INFO [Listener at localhost/34951] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/zookeeper_0, clientPort=52744, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:06,218 INFO [Listener at localhost/34951] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52744 2023-02-09 06:03:06,219 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,220 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,248 INFO [Listener at localhost/34951] util.FSUtils(479): Created version file at hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c with version=8 2023-02-09 06:03:06,249 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,250 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,251 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/hbase-staging 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:06,253 INFO [Listener at localhost/34951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:06,256 INFO [Listener at localhost/34951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33743 2023-02-09 06:03:06,257 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,258 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,259 INFO [Listener at localhost/34951] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33743 connecting to ZooKeeper ensemble=127.0.0.1:52744 2023-02-09 06:03:06,268 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:337430x0, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:06,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33743-0x10037ad242a0000 connected 2023-02-09 06:03:06,290 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:06,291 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:06,291 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:06,293 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33743 2023-02-09 06:03:06,293 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33743 2023-02-09 06:03:06,296 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33743 2023-02-09 06:03:06,298 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33743 2023-02-09 06:03:06,298 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33743 2023-02-09 06:03:06,298 INFO [Listener at localhost/34951] master.HMaster(439): hbase.rootdir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c, hbase.cluster.distributed=false 2023-02-09 06:03:06,312 INFO [Listener at localhost/34951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:06,313 INFO [Listener at localhost/34951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:06,315 INFO [Listener at localhost/34951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36841 2023-02-09 06:03:06,316 INFO [Listener at localhost/34951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:06,319 DEBUG [Listener at localhost/34951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:06,319 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,320 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,321 INFO [Listener at localhost/34951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36841 connecting to ZooKeeper ensemble=127.0.0.1:52744 2023-02-09 06:03:06,327 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:368410x0, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:06,328 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:368410x0, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:06,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36841-0x10037ad242a0001 connected 2023-02-09 06:03:06,329 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:06,330 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:06,332 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36841 2023-02-09 06:03:06,332 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36841 2023-02-09 06:03:06,332 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36841 2023-02-09 06:03:06,336 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36841 2023-02-09 06:03:06,336 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36841 2023-02-09 06:03:06,350 INFO [Listener at localhost/34951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:06,350 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,350 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,350 INFO [Listener at localhost/34951] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:06,350 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:06,351 INFO [Listener at localhost/34951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:06,351 INFO [Listener at localhost/34951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:06,353 INFO [Listener at localhost/34951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35721 2023-02-09 06:03:06,353 INFO [Listener at localhost/34951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:06,357 DEBUG [Listener at localhost/34951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:06,357 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,359 INFO [Listener at localhost/34951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,360 INFO [Listener at localhost/34951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35721 connecting to ZooKeeper ensemble=127.0.0.1:52744 2023-02-09 06:03:06,372 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:357210x0, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:06,374 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:357210x0, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:06,375 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:357210x0, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:06,375 DEBUG [Listener at localhost/34951] zookeeper.ZKUtil(164): regionserver:357210x0, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:06,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35721-0x10037ad242a0002 connected 2023-02-09 06:03:06,392 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35721 2023-02-09 06:03:06,394 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35721 2023-02-09 06:03:06,395 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35721 2023-02-09 06:03:06,400 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35721 2023-02-09 06:03:06,403 DEBUG [Listener at localhost/34951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35721 2023-02-09 06:03:06,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,412 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:06,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,417 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:06,417 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:06,417 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,417 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:06,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:06,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33743,1675922586252 from backup master directory 2023-02-09 06:03:06,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:06,425 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:06,425 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,425 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:06,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/hbase.id with ID: 0e712a6f-bf61-493c-b172-7a933ffe245a 2023-02-09 06:03:06,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:06,465 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2180efc5 to 127.0.0.1:52744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:06,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cfa6465, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:06,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:06,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:06,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:06,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store-tmp 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:06,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:06,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:06,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922586501Disabling compacts and flushes for region at 1675922586501Disabling writes for close at 1675922586501Writing region close event to WAL at 1675922586501Closed at 1675922586501 2023-02-09 06:03:06,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/WALs/jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33743%2C1675922586252, suffix=, logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/WALs/jenkins-hbase4.apache.org,33743,1675922586252, archiveDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:06,524 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK] 2023-02-09 06:03:06,531 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK] 2023-02-09 06:03:06,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/WALs/jenkins-hbase4.apache.org,33743,1675922586252/jenkins-hbase4.apache.org%2C33743%2C1675922586252.1675922586506 2023-02-09 06:03:06,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK], DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK]] 2023-02-09 06:03:06,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:06,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:06,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,543 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,545 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:06,545 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:06,546 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:06,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:06,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:06,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73085425, jitterRate=0.08905769884586334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:06,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922586541Initializing all the Stores at 1675922586543 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922586543Cleaning up temporary data from old regions at 1675922586548 (+5 ms)Cleaning up detritus from prior splits at 1675922586548Region opened successfully at 1675922586553 (+5 ms) 2023-02-09 06:03:06,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:06,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:06,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:06,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:06,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:06,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:06,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:06,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:06,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:06,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:06,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:06,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:06,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:06,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:06,577 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:06,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:06,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:06,582 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:06,582 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:06,582 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,582 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:06,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33743,1675922586252, sessionid=0x10037ad242a0000, setting cluster-up flag (Was=false) 2023-02-09 06:03:06,593 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:06,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,603 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:06,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:06,611 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/.tmp 2023-02-09 06:03:06,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:06,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922616616 2023-02-09 06:03:06,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:06,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:06,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:06,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:06,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:06,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:06,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,620 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:06,620 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:06,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:06,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:06,622 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:06,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:06,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:06,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:06,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922586624,5,FailOnTimeoutGroup] 2023-02-09 06:03:06,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922586629,5,FailOnTimeoutGroup] 2023-02-09 06:03:06,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:06,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,643 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:06,644 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:06,644 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c 2023-02-09 06:03:06,660 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:06,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:06,664 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/info 2023-02-09 06:03:06,665 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:06,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:06,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:06,668 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:06,669 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:06,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:06,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:06,671 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/table 2023-02-09 06:03:06,672 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:06,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:06,673 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740 2023-02-09 06:03:06,674 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740 2023-02-09 06:03:06,677 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:06,678 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:06,680 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:06,681 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65296540, jitterRate=-0.02700573205947876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:06,681 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922586660Initializing all the Stores at 1675922586661 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922586661Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922586662 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922586662Cleaning up temporary data from old regions at 1675922586675 (+13 ms)Cleaning up detritus from prior splits at 1675922586676 (+1 ms)Region opened successfully at 1675922586681 (+5 ms) 2023-02-09 06:03:06,681 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:06,681 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:06,681 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:06,681 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:06,681 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:06,682 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:06,682 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922586681Disabling compacts and flushes for region at 1675922586681Disabling writes for close at 1675922586681Writing region close event to WAL at 1675922586682 (+1 ms)Closed at 1675922586682 2023-02-09 06:03:06,684 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:06,684 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:06,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:06,686 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:06,687 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:06,711 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(952): ClusterId : 0e712a6f-bf61-493c-b172-7a933ffe245a 2023-02-09 06:03:06,711 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(952): ClusterId : 0e712a6f-bf61-493c-b172-7a933ffe245a 2023-02-09 06:03:06,711 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:06,711 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:06,715 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:06,715 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:06,715 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:06,716 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:06,718 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:06,719 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:06,721 DEBUG [RS:1;jenkins-hbase4:35721] zookeeper.ReadOnlyZKClient(139): Connect 0x00f1f754 to 127.0.0.1:52744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:06,721 DEBUG [RS:0;jenkins-hbase4:36841] zookeeper.ReadOnlyZKClient(139): Connect 0x00a1aa2f to 127.0.0.1:52744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:06,749 DEBUG [RS:0;jenkins-hbase4:36841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e66544b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:06,749 DEBUG [RS:1;jenkins-hbase4:35721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e36193a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:06,749 DEBUG [RS:1;jenkins-hbase4:35721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a099c24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:06,749 DEBUG [RS:0;jenkins-hbase4:36841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a59c15f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:06,767 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36841 2023-02-09 06:03:06,767 INFO [RS:0;jenkins-hbase4:36841] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:06,767 INFO [RS:0;jenkins-hbase4:36841] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:06,767 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:06,768 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33743,1675922586252 with isa=jenkins-hbase4.apache.org/172.31.14.131:36841, startcode=1675922586312 2023-02-09 06:03:06,768 DEBUG [RS:0;jenkins-hbase4:36841] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:06,771 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35721 2023-02-09 06:03:06,771 INFO [RS:1;jenkins-hbase4:35721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:06,771 INFO [RS:1;jenkins-hbase4:35721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:06,771 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:06,773 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38463, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:06,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,774 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33743,1675922586252 with isa=jenkins-hbase4.apache.org/172.31.14.131:35721, startcode=1675922586349 2023-02-09 06:03:06,774 DEBUG [RS:1;jenkins-hbase4:35721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:06,775 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c 2023-02-09 06:03:06,775 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41121 2023-02-09 06:03:06,775 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:06,778 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:06,779 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51093, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:06,779 DEBUG [RS:0;jenkins-hbase4:36841] zookeeper.ZKUtil(162): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,780 WARN [RS:0;jenkins-hbase4:36841] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:06,780 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36841,1675922586312] 2023-02-09 06:03:06,780 INFO [RS:0;jenkins-hbase4:36841] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:06,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,780 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,780 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c 2023-02-09 06:03:06,781 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41121 2023-02-09 06:03:06,781 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:06,786 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:06,786 DEBUG [RS:1;jenkins-hbase4:35721] zookeeper.ZKUtil(162): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,786 WARN [RS:1;jenkins-hbase4:35721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:06,786 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35721,1675922586349] 2023-02-09 06:03:06,786 INFO [RS:1;jenkins-hbase4:35721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:06,787 DEBUG [RS:0;jenkins-hbase4:36841] zookeeper.ZKUtil(162): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,787 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,787 DEBUG [RS:0;jenkins-hbase4:36841] zookeeper.ZKUtil(162): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,789 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:06,789 INFO [RS:0;jenkins-hbase4:36841] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:06,791 DEBUG [RS:1;jenkins-hbase4:35721] zookeeper.ZKUtil(162): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,792 INFO [RS:0;jenkins-hbase4:36841] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:06,792 INFO [RS:0;jenkins-hbase4:36841] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:06,793 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,795 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:06,803 DEBUG [RS:1;jenkins-hbase4:35721] zookeeper.ZKUtil(162): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,804 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,804 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:06,804 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:06,805 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,805 INFO [RS:1;jenkins-hbase4:35721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:06,805 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,805 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,805 DEBUG [RS:0;jenkins-hbase4:36841] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,812 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,812 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,812 INFO [RS:1;jenkins-hbase4:35721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:06,812 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,813 INFO [RS:1;jenkins-hbase4:35721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:06,813 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,813 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:06,814 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,815 DEBUG [RS:1;jenkins-hbase4:35721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:06,816 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,816 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,816 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,826 INFO [RS:0;jenkins-hbase4:36841] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:06,826 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36841,1675922586312-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,827 INFO [RS:1;jenkins-hbase4:35721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:06,827 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35721,1675922586349-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:06,838 DEBUG [jenkins-hbase4:33743] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:06,838 DEBUG [jenkins-hbase4:33743] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:06,839 INFO [RS:0;jenkins-hbase4:36841] regionserver.Replication(203): jenkins-hbase4.apache.org,36841,1675922586312 started 2023-02-09 06:03:06,839 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36841,1675922586312, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36841, sessionid=0x10037ad242a0001 2023-02-09 06:03:06,839 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:06,839 DEBUG [RS:0;jenkins-hbase4:36841] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,839 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36841,1675922586312' 2023-02-09 06:03:06,839 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:06,839 INFO [RS:1;jenkins-hbase4:35721] regionserver.Replication(203): jenkins-hbase4.apache.org,35721,1675922586349 started 2023-02-09 06:03:06,839 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:06,839 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35721,1675922586349, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35721, sessionid=0x10037ad242a0002 2023-02-09 06:03:06,840 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:06,840 DEBUG [RS:1;jenkins-hbase4:35721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,840 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35721,1675922586349' 2023-02-09 06:03:06,840 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36841,1675922586312' 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:06,840 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:06,840 DEBUG [RS:0;jenkins-hbase4:36841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35721,1675922586349' 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:06,841 DEBUG [RS:0;jenkins-hbase4:36841] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:06,841 INFO [RS:0;jenkins-hbase4:36841] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:06,841 INFO [RS:0;jenkins-hbase4:36841] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:06,841 DEBUG [jenkins-hbase4:33743] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:06,841 DEBUG [jenkins-hbase4:33743] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:06,841 DEBUG [jenkins-hbase4:33743] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:06,841 DEBUG [RS:1;jenkins-hbase4:35721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:06,842 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36841,1675922586312, state=OPENING 2023-02-09 06:03:06,843 DEBUG [RS:1;jenkins-hbase4:35721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:06,843 INFO [RS:1;jenkins-hbase4:35721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:06,843 INFO [RS:1;jenkins-hbase4:35721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:06,845 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:06,846 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:06,847 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:06,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:07,002 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:07,002 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:07,005 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:07,010 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:07,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:07,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36841%2C1675922586312.meta, suffix=.meta, logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,36841,1675922586312, archiveDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs, maxLogs=32 2023-02-09 06:03:07,038 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK] 2023-02-09 06:03:07,038 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK] 2023-02-09 06:03:07,040 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,36841,1675922586312/jenkins-hbase4.apache.org%2C36841%2C1675922586312.meta.1675922587014.meta 2023-02-09 06:03:07,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK], DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK]] 2023-02-09 06:03:07,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:07,047 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:07,047 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:07,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:07,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:07,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:07,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:07,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:07,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/info 2023-02-09 06:03:07,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/info 2023-02-09 06:03:07,053 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:07,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:07,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:07,055 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:07,055 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:07,056 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:07,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:07,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:07,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/table 2023-02-09 06:03:07,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/table 2023-02-09 06:03:07,058 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:07,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:07,059 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740 2023-02-09 06:03:07,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740 2023-02-09 06:03:07,063 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:07,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:07,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67382814, jitterRate=0.004082173109054565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:07,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922587050Writing region info on filesystem at 1675922587050Initializing all the Stores at 1675922587051 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922587051Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922587051Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922587051Cleaning up temporary data from old regions at 1675922587061 (+10 ms)Cleaning up detritus from prior splits at 1675922587062 (+1 ms)Running coprocessor post-open hooks at 1675922587065 (+3 ms)Region opened successfully at 1675922587065 2023-02-09 06:03:07,066 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922587002 2023-02-09 06:03:07,070 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:07,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:07,071 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36841,1675922586312, state=OPEN 2023-02-09 06:03:07,072 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:07,072 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:07,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:07,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36841,1675922586312 in 225 msec 2023-02-09 06:03:07,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:07,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 390 msec 2023-02-09 06:03:07,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 465 msec 2023-02-09 06:03:07,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922586415, completionTime=-1 2023-02-09 06:03:07,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:07,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:07,084 DEBUG [hconnection-0x5cdb20a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:07,087 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:07,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:07,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922647089 2023-02-09 06:03:07,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922707090 2023-02-09 06:03:07,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-09 06:03:07,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33743,1675922586252-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:07,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33743,1675922586252-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:07,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33743,1675922586252-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:07,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33743, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:07,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:07,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:07,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:07,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:07,103 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:07,103 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:07,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:07,106 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,107 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5 empty. 2023-02-09 06:03:07,107 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,107 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:07,136 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:07,138 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 031a80b65f1e510cd257bcf65fb0b3b5, NAME => 'hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 031a80b65f1e510cd257bcf65fb0b3b5, disabling compactions & flushes 2023-02-09 06:03:07,158 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. after waiting 0 ms 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,158 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 031a80b65f1e510cd257bcf65fb0b3b5: Waiting for close lock at 1675922587158Disabling compacts and flushes for region at 1675922587158Disabling writes for close at 1675922587158Writing region close event to WAL at 1675922587158Closed at 1675922587158 2023-02-09 06:03:07,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:07,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922587162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587162"}]},"ts":"1675922587162"} 2023-02-09 06:03:07,166 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:07,168 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:07,168 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922587168"}]},"ts":"1675922587168"} 2023-02-09 06:03:07,170 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:07,182 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:07,183 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:07,183 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:07,183 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:07,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=031a80b65f1e510cd257bcf65fb0b3b5, ASSIGN}] 2023-02-09 06:03:07,187 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=031a80b65f1e510cd257bcf65fb0b3b5, ASSIGN 2023-02-09 06:03:07,188 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=031a80b65f1e510cd257bcf65fb0b3b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,338 INFO [jenkins-hbase4:33743] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:07,339 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=031a80b65f1e510cd257bcf65fb0b3b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:07,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922587339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922587339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922587339"}]},"ts":"1675922587339"} 2023-02-09 06:03:07,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 031a80b65f1e510cd257bcf65fb0b3b5, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:07,495 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:07,495 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:07,500 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40688, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:07,505 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,507 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35721%2C1675922586349, suffix=, logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,35721,1675922586349, archiveDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs, maxLogs=32 2023-02-09 06:03:07,525 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK] 2023-02-09 06:03:07,525 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK] 2023-02-09 06:03:07,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,35721,1675922586349/jenkins-hbase4.apache.org%2C35721%2C1675922586349.1675922587508 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK], DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK]] 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 031a80b65f1e510cd257bcf65fb0b3b5, NAME => 'hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,530 INFO [StoreOpener-031a80b65f1e510cd257bcf65fb0b3b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,532 DEBUG [StoreOpener-031a80b65f1e510cd257bcf65fb0b3b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/info 2023-02-09 06:03:07,532 DEBUG [StoreOpener-031a80b65f1e510cd257bcf65fb0b3b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/info 2023-02-09 06:03:07,532 INFO [StoreOpener-031a80b65f1e510cd257bcf65fb0b3b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 031a80b65f1e510cd257bcf65fb0b3b5 columnFamilyName info 2023-02-09 06:03:07,533 INFO [StoreOpener-031a80b65f1e510cd257bcf65fb0b3b5-1] regionserver.HStore(310): Store=031a80b65f1e510cd257bcf65fb0b3b5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:07,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:07,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:07,541 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 031a80b65f1e510cd257bcf65fb0b3b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63262240, jitterRate=-0.05731916427612305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:07,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 031a80b65f1e510cd257bcf65fb0b3b5: Running coprocessor pre-open hook at 1675922587529Writing region info on filesystem at 1675922587529Initializing all the Stores at 1675922587529Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922587529Cleaning up temporary data from old regions at 1675922587535 (+6 ms)Cleaning up detritus from prior splits at 1675922587535Running coprocessor post-open hooks at 1675922587541 (+6 ms)Region opened successfully at 1675922587541 2023-02-09 06:03:07,542 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5., pid=6, masterSystemTime=1675922587495 2023-02-09 06:03:07,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:07,549 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=031a80b65f1e510cd257bcf65fb0b3b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:07,550 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922587549"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922587549"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922587549"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922587549"}]},"ts":"1675922587549"} 2023-02-09 06:03:07,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:07,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 031a80b65f1e510cd257bcf65fb0b3b5, server=jenkins-hbase4.apache.org,35721,1675922586349 in 209 msec 2023-02-09 06:03:07,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:07,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=031a80b65f1e510cd257bcf65fb0b3b5, ASSIGN in 370 msec 2023-02-09 06:03:07,557 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:07,557 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922587557"}]},"ts":"1675922587557"} 2023-02-09 06:03:07,558 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:07,561 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:07,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 461 msec 2023-02-09 06:03:07,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:07,605 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:07,605 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:07,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:07,612 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:07,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:07,624 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:07,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-09 06:03:07,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:07,643 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:07,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-09 06:03:07,661 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:07,664 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.239sec 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33743,1675922586252-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:07,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33743,1675922586252-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:07,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:07,711 DEBUG [Listener at localhost/34951] zookeeper.ReadOnlyZKClient(139): Connect 0x6cb03327 to 127.0.0.1:52744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:07,716 DEBUG [Listener at localhost/34951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57997cd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:07,718 DEBUG [hconnection-0x37db08fd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:07,721 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33648, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:07,723 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:07,723 DEBUG [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:07,723 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:07,723 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:07,725 DEBUG [Listener at localhost/34951] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:07,727 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:07,728 INFO [Listener at localhost/34951] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 06:03:07,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 06:03:07,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:07,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:36052 deadline: 1675922647728, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 06:03:07,729 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 06:03:07,729 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:07,729 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:07,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:07,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 06:03:07,734 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:07,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 06:03:07,735 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:07,735 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:07,735 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:07,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:07,745 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68 empty. 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530 empty. 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d empty. 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f empty. 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a empty. 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:07,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b empty. 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa empty. 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5 empty. 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e empty. 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38 empty. 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:07,747 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:07,748 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:07,748 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:07,748 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 06:03:07,759 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:07,761 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ec55c3edfc49ef841c2000d11245d19f, NAME => 'testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,761 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f2ddb856158359060e2511bb40ce530, NAME => 'testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,761 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2f32e10b7da81f7bf0cf85083961a6d5, NAME => 'testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ec55c3edfc49ef841c2000d11245d19f, disabling compactions & flushes 2023-02-09 06:03:07,777 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. after waiting 0 ms 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:07,777 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:07,777 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ec55c3edfc49ef841c2000d11245d19f: Waiting for close lock at 1675922587777Disabling compacts and flushes for region at 1675922587777Disabling writes for close at 1675922587777Writing region close event to WAL at 1675922587777Closed at 1675922587777 2023-02-09 06:03:07,778 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6bce83b18f225424b9461a90fe0a8f68, NAME => 'testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,781 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,781 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2f32e10b7da81f7bf0cf85083961a6d5, disabling compactions & flushes 2023-02-09 06:03:07,781 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:07,781 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:07,781 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. after waiting 0 ms 2023-02-09 06:03:07,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:07,782 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:07,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2f32e10b7da81f7bf0cf85083961a6d5: Waiting for close lock at 1675922587781Disabling compacts and flushes for region at 1675922587781Disabling writes for close at 1675922587782 (+1 ms)Writing region close event to WAL at 1675922587782Closed at 1675922587782 2023-02-09 06:03:07,782 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => dd03b135d141ff9e500396ed4cb9966d, NAME => 'testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,784 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3f2ddb856158359060e2511bb40ce530, disabling compactions & flushes 2023-02-09 06:03:07,785 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:07,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:07,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. after waiting 0 ms 2023-02-09 06:03:07,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:07,785 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:07,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3f2ddb856158359060e2511bb40ce530: Waiting for close lock at 1675922587785Disabling compacts and flushes for region at 1675922587785Disabling writes for close at 1675922587785Writing region close event to WAL at 1675922587785Closed at 1675922587785 2023-02-09 06:03:07,785 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d10b4f9dbd22ffe39dfd0ff87c38b6fa, NAME => 'testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6bce83b18f225424b9461a90fe0a8f68, disabling compactions & flushes 2023-02-09 06:03:07,793 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. after waiting 0 ms 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:07,793 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:07,793 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6bce83b18f225424b9461a90fe0a8f68: Waiting for close lock at 1675922587793Disabling compacts and flushes for region at 1675922587793Disabling writes for close at 1675922587793Writing region close event to WAL at 1675922587793Closed at 1675922587793 2023-02-09 06:03:07,794 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1ec122195731eb943af0673fb30f7b2b, NAME => 'testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d10b4f9dbd22ffe39dfd0ff87c38b6fa, disabling compactions & flushes 2023-02-09 06:03:07,795 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. after waiting 0 ms 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:07,795 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:07,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Waiting for close lock at 1675922587795Disabling compacts and flushes for region at 1675922587795Disabling writes for close at 1675922587795Writing region close event to WAL at 1675922587795Closed at 1675922587795 2023-02-09 06:03:07,796 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c03e57d2c1d15d47053374a61af9790a, NAME => 'testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing dd03b135d141ff9e500396ed4cb9966d, disabling compactions & flushes 2023-02-09 06:03:07,800 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. after waiting 0 ms 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:07,800 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:07,800 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for dd03b135d141ff9e500396ed4cb9966d: Waiting for close lock at 1675922587800Disabling compacts and flushes for region at 1675922587800Disabling writes for close at 1675922587800Writing region close event to WAL at 1675922587800Closed at 1675922587800 2023-02-09 06:03:07,801 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 31ec182f145fee9b2fa8d74e1945e35e, NAME => 'testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1ec122195731eb943af0673fb30f7b2b, disabling compactions & flushes 2023-02-09 06:03:07,810 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. after waiting 0 ms 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:07,810 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:07,810 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1ec122195731eb943af0673fb30f7b2b: Waiting for close lock at 1675922587810Disabling compacts and flushes for region at 1675922587810Disabling writes for close at 1675922587810Writing region close event to WAL at 1675922587810Closed at 1675922587810 2023-02-09 06:03:07,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08a04ea3aa886ab428bf1248b056eb38, NAME => 'testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.tmp 2023-02-09 06:03:07,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c03e57d2c1d15d47053374a61af9790a, disabling compactions & flushes 2023-02-09 06:03:07,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. after waiting 0 ms 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:07,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c03e57d2c1d15d47053374a61af9790a: Waiting for close lock at 1675922587812Disabling compacts and flushes for region at 1675922587812Disabling writes for close at 1675922587812Writing region close event to WAL at 1675922587812Closed at 1675922587812 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 31ec182f145fee9b2fa8d74e1945e35e, disabling compactions & flushes 2023-02-09 06:03:07,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. after waiting 0 ms 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:07,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:07,812 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 31ec182f145fee9b2fa8d74e1945e35e: Waiting for close lock at 1675922587812Disabling compacts and flushes for region at 1675922587812Disabling writes for close at 1675922587812Writing region close event to WAL at 1675922587812Closed at 1675922587812 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 08a04ea3aa886ab428bf1248b056eb38, disabling compactions & flushes 2023-02-09 06:03:07,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. after waiting 0 ms 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:07,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:07,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 08a04ea3aa886ab428bf1248b056eb38: Waiting for close lock at 1675922587822Disabling compacts and flushes for region at 1675922587822Disabling writes for close at 1675922587822Writing region close event to WAL at 1675922587822Closed at 1675922587822 2023-02-09 06:03:07,825 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922587825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922587825"}]},"ts":"1675922587825"} 2023-02-09 06:03:07,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 06:03:07,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:07,831 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922587831"}]},"ts":"1675922587831"} 2023-02-09 06:03:07,833 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 06:03:07,836 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:07,837 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:07,837 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:07,843 INFO [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36841%2C1675922586312, suffix=, logDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,36841,1675922586312, archiveDir=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs, maxLogs=32 2023-02-09 06:03:07,854 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:07,854 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:07,854 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:07,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f2ddb856158359060e2511bb40ce530, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ec55c3edfc49ef841c2000d11245d19f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2f32e10b7da81f7bf0cf85083961a6d5, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6bce83b18f225424b9461a90fe0a8f68, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dd03b135d141ff9e500396ed4cb9966d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d10b4f9dbd22ffe39dfd0ff87c38b6fa, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec122195731eb943af0673fb30f7b2b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c03e57d2c1d15d47053374a61af9790a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=31ec182f145fee9b2fa8d74e1945e35e, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08a04ea3aa886ab428bf1248b056eb38, ASSIGN}] 2023-02-09 06:03:07,858 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08a04ea3aa886ab428bf1248b056eb38, ASSIGN 2023-02-09 06:03:07,858 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=31ec182f145fee9b2fa8d74e1945e35e, ASSIGN 2023-02-09 06:03:07,858 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c03e57d2c1d15d47053374a61af9790a, ASSIGN 2023-02-09 06:03:07,858 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec122195731eb943af0673fb30f7b2b, ASSIGN 2023-02-09 06:03:07,859 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08a04ea3aa886ab428bf1248b056eb38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36841,1675922586312; forceNewPlan=false, retain=false 2023-02-09 06:03:07,860 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1ec122195731eb943af0673fb30f7b2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,859 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=31ec182f145fee9b2fa8d74e1945e35e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,859 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c03e57d2c1d15d47053374a61af9790a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36841,1675922586312; forceNewPlan=false, retain=false 2023-02-09 06:03:07,862 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK] 2023-02-09 06:03:07,869 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK] 2023-02-09 06:03:07,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d10b4f9dbd22ffe39dfd0ff87c38b6fa, ASSIGN 2023-02-09 06:03:07,870 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dd03b135d141ff9e500396ed4cb9966d, ASSIGN 2023-02-09 06:03:07,870 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6bce83b18f225424b9461a90fe0a8f68, ASSIGN 2023-02-09 06:03:07,877 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2f32e10b7da81f7bf0cf85083961a6d5, ASSIGN 2023-02-09 06:03:07,877 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ec55c3edfc49ef841c2000d11245d19f, ASSIGN 2023-02-09 06:03:07,877 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d10b4f9dbd22ffe39dfd0ff87c38b6fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,877 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dd03b135d141ff9e500396ed4cb9966d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36841,1675922586312; forceNewPlan=false, retain=false 2023-02-09 06:03:07,878 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6bce83b18f225424b9461a90fe0a8f68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36841,1675922586312; forceNewPlan=false, retain=false 2023-02-09 06:03:07,878 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2f32e10b7da81f7bf0cf85083961a6d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36841,1675922586312; forceNewPlan=false, retain=false 2023-02-09 06:03:07,878 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ec55c3edfc49ef841c2000d11245d19f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f2ddb856158359060e2511bb40ce530, ASSIGN 2023-02-09 06:03:07,879 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3f2ddb856158359060e2511bb40ce530, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35721,1675922586349; forceNewPlan=false, retain=false 2023-02-09 06:03:07,879 INFO [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/WALs/jenkins-hbase4.apache.org,36841,1675922586312/jenkins-hbase4.apache.org%2C36841%2C1675922586312.1675922587845 2023-02-09 06:03:07,880 DEBUG [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46771,DS-d0ce5b83-3e43-4bb5-a747-298d92538f48,DISK], DatanodeInfoWithStorage[127.0.0.1:39049,DS-e10e9388-1121-4f38-b7d1-60dcbbe7e74d,DISK]] 2023-02-09 06:03:08,010 INFO [jenkins-hbase4:33743] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 06:03:08,015 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6bce83b18f225424b9461a90fe0a8f68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2f32e10b7da81f7bf0cf85083961a6d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588015"}]},"ts":"1675922588015"} 2023-02-09 06:03:08,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588015"}]},"ts":"1675922588015"} 2023-02-09 06:03:08,015 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c03e57d2c1d15d47053374a61af9790a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,016 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=08a04ea3aa886ab428bf1248b056eb38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588015"}]},"ts":"1675922588015"} 2023-02-09 06:03:08,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922588016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588016"}]},"ts":"1675922588016"} 2023-02-09 06:03:08,016 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=dd03b135d141ff9e500396ed4cb9966d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588016"}]},"ts":"1675922588016"} 2023-02-09 06:03:08,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 6bce83b18f225424b9461a90fe0a8f68, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:08,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 2f32e10b7da81f7bf0cf85083961a6d5, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:08,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure c03e57d2c1d15d47053374a61af9790a, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:08,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 08a04ea3aa886ab428bf1248b056eb38, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:08,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure dd03b135d141ff9e500396ed4cb9966d, server=jenkins-hbase4.apache.org,36841,1675922586312}] 2023-02-09 06:03:08,028 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1ec122195731eb943af0673fb30f7b2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588027"}]},"ts":"1675922588027"} 2023-02-09 06:03:08,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f2ddb856158359060e2511bb40ce530, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922588028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588028"}]},"ts":"1675922588028"} 2023-02-09 06:03:08,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ec55c3edfc49ef841c2000d11245d19f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d10b4f9dbd22ffe39dfd0ff87c38b6fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,029 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588028"}]},"ts":"1675922588028"} 2023-02-09 06:03:08,029 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=31ec182f145fee9b2fa8d74e1945e35e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,029 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588029"}]},"ts":"1675922588029"} 2023-02-09 06:03:08,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922588029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922588029"}]},"ts":"1675922588029"} 2023-02-09 06:03:08,040 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:08,040 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:08,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 3f2ddb856158359060e2511bb40ce530, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:08,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure ec55c3edfc49ef841c2000d11245d19f, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:08,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:08,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 31ec182f145fee9b2fa8d74e1945e35e, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:08,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure d10b4f9dbd22ffe39dfd0ff87c38b6fa, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:08,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 1ec122195731eb943af0673fb30f7b2b, server=jenkins-hbase4.apache.org,35721,1675922586349}] 2023-02-09 06:03:08,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6bce83b18f225424b9461a90fe0a8f68, NAME => 'testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 06:03:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,178 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,179 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1 2023-02-09 06:03:08,179 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1 2023-02-09 06:03:08,180 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bce83b18f225424b9461a90fe0a8f68 columnFamilyName f1 2023-02-09 06:03:08,180 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(310): Store=6bce83b18f225424b9461a90fe0a8f68/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,180 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,182 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2 2023-02-09 06:03:08,182 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2 2023-02-09 06:03:08,182 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bce83b18f225424b9461a90fe0a8f68 columnFamilyName f2 2023-02-09 06:03:08,183 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(310): Store=6bce83b18f225424b9461a90fe0a8f68/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:08,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6bce83b18f225424b9461a90fe0a8f68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73222255, jitterRate=0.09109662473201752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6bce83b18f225424b9461a90fe0a8f68: Running coprocessor pre-open hook at 1675922588176Writing region info on filesystem at 1675922588176Initializing all the Stores at 1675922588177 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588177Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588177Cleaning up temporary data from old regions at 1675922588185 (+8 ms)Cleaning up detritus from prior splits at 1675922588186 (+1 ms)Running coprocessor post-open hooks at 1675922588192 (+6 ms)Region opened successfully at 1675922588192 2023-02-09 06:03:08,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68., pid=21, masterSystemTime=1675922588171 2023-02-09 06:03:08,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:08,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f2ddb856158359060e2511bb40ce530, NAME => 'testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 06:03:08,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:08,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c03e57d2c1d15d47053374a61af9790a, NAME => 'testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,197 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6bce83b18f225424b9461a90fe0a8f68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,197 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588197"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588197"}]},"ts":"1675922588197"} 2023-02-09 06:03:08,198 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,200 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,200 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f1 2023-02-09 06:03:08,200 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f1 2023-02-09 06:03:08,201 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f2ddb856158359060e2511bb40ce530 columnFamilyName f1 2023-02-09 06:03:08,201 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(310): Store=3f2ddb856158359060e2511bb40ce530/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,202 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1 2023-02-09 06:03:08,202 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,202 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1 2023-02-09 06:03:08,202 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03e57d2c1d15d47053374a61af9790a columnFamilyName f1 2023-02-09 06:03:08,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-09 06:03:08,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 6bce83b18f225424b9461a90fe0a8f68, server=jenkins-hbase4.apache.org,36841,1675922586312 in 182 msec 2023-02-09 06:03:08,203 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(310): Store=c03e57d2c1d15d47053374a61af9790a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,203 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6bce83b18f225424b9461a90fe0a8f68, ASSIGN in 348 msec 2023-02-09 06:03:08,204 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f2 2023-02-09 06:03:08,204 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f2 2023-02-09 06:03:08,205 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2 2023-02-09 06:03:08,205 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2 2023-02-09 06:03:08,208 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f2ddb856158359060e2511bb40ce530 columnFamilyName f2 2023-02-09 06:03:08,208 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03e57d2c1d15d47053374a61af9790a columnFamilyName f2 2023-02-09 06:03:08,209 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(310): Store=3f2ddb856158359060e2511bb40ce530/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,209 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(310): Store=c03e57d2c1d15d47053374a61af9790a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:08,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f2ddb856158359060e2511bb40ce530; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72676550, jitterRate=0.08296498656272888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c03e57d2c1d15d47053374a61af9790a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63267226, jitterRate=-0.05724486708641052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f2ddb856158359060e2511bb40ce530: Running coprocessor pre-open hook at 1675922588197Writing region info on filesystem at 1675922588197Initializing all the Stores at 1675922588198 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588198Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588198Cleaning up temporary data from old regions at 1675922588211 (+13 ms)Cleaning up detritus from prior splits at 1675922588212 (+1 ms)Running coprocessor post-open hooks at 1675922588219 (+7 ms)Region opened successfully at 1675922588219 2023-02-09 06:03:08,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c03e57d2c1d15d47053374a61af9790a: Running coprocessor pre-open hook at 1675922588198Writing region info on filesystem at 1675922588198Initializing all the Stores at 1675922588199 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588200 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588200Cleaning up temporary data from old regions at 1675922588211 (+11 ms)Cleaning up detritus from prior splits at 1675922588212 (+1 ms)Running coprocessor post-open hooks at 1675922588219 (+7 ms)Region opened successfully at 1675922588219 2023-02-09 06:03:08,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530., pid=26, masterSystemTime=1675922588192 2023-02-09 06:03:08,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a., pid=23, masterSystemTime=1675922588171 2023-02-09 06:03:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec55c3edfc49ef841c2000d11245d19f, NAME => 'testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 06:03:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,227 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f2ddb856158359060e2511bb40ce530, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,227 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922588227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588227"}]},"ts":"1675922588227"} 2023-02-09 06:03:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:08,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:08,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dd03b135d141ff9e500396ed4cb9966d, NAME => 'testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 06:03:08,229 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c03e57d2c1d15d47053374a61af9790a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,229 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,229 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588229"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588229"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588229"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588229"}]},"ts":"1675922588229"} 2023-02-09 06:03:08,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,231 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1 2023-02-09 06:03:08,231 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1 2023-02-09 06:03:08,231 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec55c3edfc49ef841c2000d11245d19f columnFamilyName f1 2023-02-09 06:03:08,232 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(310): Store=ec55c3edfc49ef841c2000d11245d19f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,232 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-09 06:03:08,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 3f2ddb856158359060e2511bb40ce530, server=jenkins-hbase4.apache.org,35721,1675922586349 in 192 msec 2023-02-09 06:03:08,234 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2 2023-02-09 06:03:08,234 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2 2023-02-09 06:03:08,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-09 06:03:08,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f2ddb856158359060e2511bb40ce530, ASSIGN in 379 msec 2023-02-09 06:03:08,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure c03e57d2c1d15d47053374a61af9790a, server=jenkins-hbase4.apache.org,36841,1675922586312 in 211 msec 2023-02-09 06:03:08,234 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec55c3edfc49ef841c2000d11245d19f columnFamilyName f2 2023-02-09 06:03:08,235 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(310): Store=ec55c3edfc49ef841c2000d11245d19f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c03e57d2c1d15d47053374a61af9790a, ASSIGN in 380 msec 2023-02-09 06:03:08,236 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,238 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1 2023-02-09 06:03:08,238 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1 2023-02-09 06:03:08,238 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd03b135d141ff9e500396ed4cb9966d columnFamilyName f1 2023-02-09 06:03:08,239 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(310): Store=dd03b135d141ff9e500396ed4cb9966d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,239 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,240 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2 2023-02-09 06:03:08,240 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2 2023-02-09 06:03:08,241 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd03b135d141ff9e500396ed4cb9966d columnFamilyName f2 2023-02-09 06:03:08,241 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(310): Store=dd03b135d141ff9e500396ed4cb9966d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:08,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dd03b135d141ff9e500396ed4cb9966d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59229127, jitterRate=-0.11741723120212555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dd03b135d141ff9e500396ed4cb9966d: Running coprocessor pre-open hook at 1675922588229Writing region info on filesystem at 1675922588229Initializing all the Stores at 1675922588230 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588230Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588236 (+6 ms)Cleaning up temporary data from old regions at 1675922588243 (+7 ms)Cleaning up detritus from prior splits at 1675922588244 (+1 ms)Running coprocessor post-open hooks at 1675922588253 (+9 ms)Region opened successfully at 1675922588253 2023-02-09 06:03:08,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d., pid=25, masterSystemTime=1675922588171 2023-02-09 06:03:08,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:08,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:08,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:08,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:08,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2f32e10b7da81f7bf0cf85083961a6d5, NAME => 'testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 06:03:08,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=dd03b135d141ff9e500396ed4cb9966d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588256"}]},"ts":"1675922588256"} 2023-02-09 06:03:08,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,260 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ec55c3edfc49ef841c2000d11245d19f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59518185, jitterRate=-0.11310993134975433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ec55c3edfc49ef841c2000d11245d19f: Running coprocessor pre-open hook at 1675922588227Writing region info on filesystem at 1675922588227Initializing all the Stores at 1675922588228 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588229 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588229Cleaning up temporary data from old regions at 1675922588253 (+24 ms)Cleaning up detritus from prior splits at 1675922588254 (+1 ms)Running coprocessor post-open hooks at 1675922588262 (+8 ms)Region opened successfully at 1675922588262 2023-02-09 06:03:08,263 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1 2023-02-09 06:03:08,263 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1 2023-02-09 06:03:08,263 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f32e10b7da81f7bf0cf85083961a6d5 columnFamilyName f1 2023-02-09 06:03:08,264 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(310): Store=2f32e10b7da81f7bf0cf85083961a6d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,264 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-09 06:03:08,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f., pid=27, masterSystemTime=1675922588192 2023-02-09 06:03:08,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure dd03b135d141ff9e500396ed4cb9966d, server=jenkins-hbase4.apache.org,36841,1675922586312 in 239 msec 2023-02-09 06:03:08,265 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2 2023-02-09 06:03:08,265 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2 2023-02-09 06:03:08,266 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f32e10b7da81f7bf0cf85083961a6d5 columnFamilyName f2 2023-02-09 06:03:08,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dd03b135d141ff9e500396ed4cb9966d, ASSIGN in 410 msec 2023-02-09 06:03:08,267 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(310): Store=2f32e10b7da81f7bf0cf85083961a6d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:08,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:08,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:08,267 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ec55c3edfc49ef841c2000d11245d19f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ec122195731eb943af0673fb30f7b2b, NAME => 'testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 06:03:08,267 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588267"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588267"}]},"ts":"1675922588267"} 2023-02-09 06:03:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,270 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-09 06:03:08,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure ec55c3edfc49ef841c2000d11245d19f, server=jenkins-hbase4.apache.org,35721,1675922586349 in 228 msec 2023-02-09 06:03:08,271 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1 2023-02-09 06:03:08,271 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1 2023-02-09 06:03:08,272 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec122195731eb943af0673fb30f7b2b columnFamilyName f1 2023-02-09 06:03:08,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ec55c3edfc49ef841c2000d11245d19f, ASSIGN in 417 msec 2023-02-09 06:03:08,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:08,273 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(310): Store=1ec122195731eb943af0673fb30f7b2b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,273 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,275 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2 2023-02-09 06:03:08,275 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2 2023-02-09 06:03:08,275 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec122195731eb943af0673fb30f7b2b columnFamilyName f2 2023-02-09 06:03:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,277 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(310): Store=1ec122195731eb943af0673fb30f7b2b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2f32e10b7da81f7bf0cf85083961a6d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69329453, jitterRate=0.03308935463428497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2f32e10b7da81f7bf0cf85083961a6d5: Running coprocessor pre-open hook at 1675922588257Writing region info on filesystem at 1675922588257Initializing all the Stores at 1675922588258 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588259 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588260 (+1 ms)Cleaning up temporary data from old regions at 1675922588269 (+9 ms)Cleaning up detritus from prior splits at 1675922588270 (+1 ms)Running coprocessor post-open hooks at 1675922588277 (+7 ms)Region opened successfully at 1675922588277 2023-02-09 06:03:08,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5., pid=22, masterSystemTime=1675922588171 2023-02-09 06:03:08,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:08,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:08,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:08,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08a04ea3aa886ab428bf1248b056eb38, NAME => 'testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 06:03:08,280 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2f32e10b7da81f7bf0cf85083961a6d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588280"}]},"ts":"1675922588280"} 2023-02-09 06:03:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:08,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-09 06:03:08,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 2f32e10b7da81f7bf0cf85083961a6d5, server=jenkins-hbase4.apache.org,36841,1675922586312 in 263 msec 2023-02-09 06:03:08,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2f32e10b7da81f7bf0cf85083961a6d5, ASSIGN in 430 msec 2023-02-09 06:03:08,288 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ec122195731eb943af0673fb30f7b2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69659139, jitterRate=0.03800205886363983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ec122195731eb943af0673fb30f7b2b: Running coprocessor pre-open hook at 1675922588268Writing region info on filesystem at 1675922588268Initializing all the Stores at 1675922588269 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588270 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588270Cleaning up temporary data from old regions at 1675922588279 (+9 ms)Cleaning up detritus from prior splits at 1675922588280 (+1 ms)Running coprocessor post-open hooks at 1675922588289 (+9 ms)Region opened successfully at 1675922588289 2023-02-09 06:03:08,289 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f1 2023-02-09 06:03:08,289 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f1 2023-02-09 06:03:08,290 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08a04ea3aa886ab428bf1248b056eb38 columnFamilyName f1 2023-02-09 06:03:08,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b., pid=30, masterSystemTime=1675922588192 2023-02-09 06:03:08,290 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(310): Store=08a04ea3aa886ab428bf1248b056eb38/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,290 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:08,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:08,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:08,292 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f2 2023-02-09 06:03:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31ec182f145fee9b2fa8d74e1945e35e, NAME => 'testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 06:03:08,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1ec122195731eb943af0673fb30f7b2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,292 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f2 2023-02-09 06:03:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588292"}]},"ts":"1675922588292"} 2023-02-09 06:03:08,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,293 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08a04ea3aa886ab428bf1248b056eb38 columnFamilyName f2 2023-02-09 06:03:08,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,293 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(310): Store=08a04ea3aa886ab428bf1248b056eb38/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,295 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,297 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1 2023-02-09 06:03:08,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,297 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1 2023-02-09 06:03:08,297 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ec182f145fee9b2fa8d74e1945e35e columnFamilyName f1 2023-02-09 06:03:08,298 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(310): Store=31ec182f145fee9b2fa8d74e1945e35e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,298 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:08,300 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2 2023-02-09 06:03:08,300 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2 2023-02-09 06:03:08,300 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ec182f145fee9b2fa8d74e1945e35e columnFamilyName f2 2023-02-09 06:03:08,301 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(310): Store=31ec182f145fee9b2fa8d74e1945e35e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08a04ea3aa886ab428bf1248b056eb38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63738318, jitterRate=-0.05022504925727844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08a04ea3aa886ab428bf1248b056eb38: Running coprocessor pre-open hook at 1675922588281Writing region info on filesystem at 1675922588281Initializing all the Stores at 1675922588282 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588282Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588288 (+6 ms)Cleaning up temporary data from old regions at 1675922588295 (+7 ms)Cleaning up detritus from prior splits at 1675922588296 (+1 ms)Running coprocessor post-open hooks at 1675922588302 (+6 ms)Region opened successfully at 1675922588302 2023-02-09 06:03:08,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38., pid=24, masterSystemTime=1675922588171 2023-02-09 06:03:08,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:08,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-09 06:03:08,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 1ec122195731eb943af0673fb30f7b2b, server=jenkins-hbase4.apache.org,35721,1675922586349 in 249 msec 2023-02-09 06:03:08,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:08,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:08,309 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=08a04ea3aa886ab428bf1248b056eb38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:08,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31ec182f145fee9b2fa8d74e1945e35e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71765948, jitterRate=0.06939595937728882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,309 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675922588308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588308"}]},"ts":"1675922588308"} 2023-02-09 06:03:08,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31ec182f145fee9b2fa8d74e1945e35e: Running coprocessor pre-open hook at 1675922588293Writing region info on filesystem at 1675922588293Initializing all the Stores at 1675922588294 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588294Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588295 (+1 ms)Cleaning up temporary data from old regions at 1675922588303 (+8 ms)Cleaning up detritus from prior splits at 1675922588303Running coprocessor post-open hooks at 1675922588309 (+6 ms)Region opened successfully at 1675922588309 2023-02-09 06:03:08,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ec122195731eb943af0673fb30f7b2b, ASSIGN in 453 msec 2023-02-09 06:03:08,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e., pid=28, masterSystemTime=1675922588192 2023-02-09 06:03:08,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:08,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:08,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d10b4f9dbd22ffe39dfd0ff87c38b6fa, NAME => 'testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 06:03:08,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=31ec182f145fee9b2fa8d74e1945e35e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588312"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588312"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588312"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588312"}]},"ts":"1675922588312"} 2023-02-09 06:03:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-09 06:03:08,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 08a04ea3aa886ab428bf1248b056eb38, server=jenkins-hbase4.apache.org,36841,1675922586312 in 290 msec 2023-02-09 06:03:08,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08a04ea3aa886ab428bf1248b056eb38, ASSIGN in 459 msec 2023-02-09 06:03:08,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-09 06:03:08,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 31ec182f145fee9b2fa8d74e1945e35e, server=jenkins-hbase4.apache.org,35721,1675922586349 in 272 msec 2023-02-09 06:03:08,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=31ec182f145fee9b2fa8d74e1945e35e, ASSIGN in 461 msec 2023-02-09 06:03:08,317 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,319 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1 2023-02-09 06:03:08,319 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1 2023-02-09 06:03:08,319 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10b4f9dbd22ffe39dfd0ff87c38b6fa columnFamilyName f1 2023-02-09 06:03:08,320 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(310): Store=d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,320 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,323 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2 2023-02-09 06:03:08,323 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2 2023-02-09 06:03:08,323 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10b4f9dbd22ffe39dfd0ff87c38b6fa columnFamilyName f2 2023-02-09 06:03:08,324 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(310): Store=d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:08,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:08,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:08,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:08,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d10b4f9dbd22ffe39dfd0ff87c38b6fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70877285, jitterRate=0.05615384876728058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:08,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Running coprocessor pre-open hook at 1675922588312Writing region info on filesystem at 1675922588312Initializing all the Stores at 1675922588317 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588317Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922588317Cleaning up temporary data from old regions at 1675922588326 (+9 ms)Cleaning up detritus from prior splits at 1675922588326Running coprocessor post-open hooks at 1675922588331 (+5 ms)Region opened successfully at 1675922588331 2023-02-09 06:03:08,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa., pid=29, masterSystemTime=1675922588192 2023-02-09 06:03:08,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:08,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:08,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d10b4f9dbd22ffe39dfd0ff87c38b6fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:08,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675922588334"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922588334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922588334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922588334"}]},"ts":"1675922588334"} 2023-02-09 06:03:08,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-09 06:03:08,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure d10b4f9dbd22ffe39dfd0ff87c38b6fa, server=jenkins-hbase4.apache.org,35721,1675922586349 in 292 msec 2023-02-09 06:03:08,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-09 06:03:08,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d10b4f9dbd22ffe39dfd0ff87c38b6fa, ASSIGN in 484 msec 2023-02-09 06:03:08,340 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:08,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922588341"}]},"ts":"1675922588341"} 2023-02-09 06:03:08,342 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 06:03:08,343 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:08,343 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:08,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:08,346 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:08,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 615 msec 2023-02-09 06:03:08,844 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:08,845 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:08,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:08,847 INFO [Listener at localhost/34951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 06:03:08,847 DEBUG [Listener at localhost/34951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 06:03:08,847 INFO [Listener at localhost/34951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:08,856 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 06:03:08,856 INFO [Listener at localhost/34951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:08,856 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 06:03:08,857 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:08,936 DEBUG [hconnection-0x37db08fd-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:08,963 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36841] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:08,979 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:08,989 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:09,021 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 06:03:09,124 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:09,124 INFO [Listener at localhost/34951] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:09,124 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:09,124 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:09,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:09,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922589126 (current time:1675922589126). 2023-02-09 06:03:09,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:09,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] zookeeper.ReadOnlyZKClient(139): Connect 0x3d8b8e00 to 127.0.0.1:52744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:09,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c2459e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:09,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:09,156 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:09,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d8b8e00 to 127.0.0.1:52744 2023-02-09 06:03:09,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:09,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:09,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:09,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:09,166 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:09,168 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675923189168 2023-02-09 06:03:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:09,172 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 06:03:09,172 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:09,172 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:09,174 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:09,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:09,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 11 msec 2023-02-09 06:03:09,182 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:09,183 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675923189183 2023-02-09 06:03:09,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,215 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-09 06:03:09,215 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:09,216 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-09 06:03:09,216 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-09 06:03:09,264 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,264 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,266 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:09,266 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:09,266 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:09,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:09,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:09,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:09,266 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,267 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,267 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,267 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 06:03:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,268 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 06:03:09,268 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:09,268 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 06:03:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 06:03:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 06:03:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 06:03:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 06:03:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35721,1675922586349' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 06:03:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36841,1675922586312' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 06:03:09,273 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:09,273 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,273 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,273 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:09,273 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:09,274 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:09,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:09,275 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:09,275 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,276 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,277 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35721,1675922586349' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17243e00[Count = 1] remaining members to acquire global barrier 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:09,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36841,1675922586312' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 06:03:09,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17243e00[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:09,285 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-09 06:03:09,285 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,287 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:09,287 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,287 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:09,288 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. started... 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. started... 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:09,293 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:09,293 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. started... 2023-02-09 06:03:09,294 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. started... 2023-02-09 06:03:09,293 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:03:09,295 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:09,295 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c03e57d2c1d15d47053374a61af9790a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,292 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. started... 2023-02-09 06:03:09,293 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ec55c3edfc49ef841c2000d11245d19f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:03:09,293 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dd03b135d141ff9e500396ed4cb9966d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,293 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:03:09,296 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:09,296 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:09,296 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1ec122195731eb943af0673fb30f7b2b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,296 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2f32e10b7da81f7bf0cf85083961a6d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,304 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. started... 2023-02-09 06:03:09,305 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d10b4f9dbd22ffe39dfd0ff87c38b6fa 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,500 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f1/e22e04a50f6e4a45aef8d5630ebcf4ee 2023-02-09 06:03:09,501 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f1/40b0ced009124de295b7e5ef3a9dc800 2023-02-09 06:03:09,507 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f1/69535fb5860f45d391f5f24885be123f 2023-02-09 06:03:09,508 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f1/bcfa1a0231b746fbb3e607e1879c80f2 2023-02-09 06:03:09,508 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:09,508 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:09,508 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:09,510 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 06:03:09,554 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f2/809be0c88168436aa5ab7a494653d528 2023-02-09 06:03:09,560 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f2/340ef70fb6d64e9dbd82253066612e09 2023-02-09 06:03:09,568 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f1/40b0ced009124de295b7e5ef3a9dc800 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/40b0ced009124de295b7e5ef3a9dc800 2023-02-09 06:03:09,572 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f2/f94801481721468fbe3c12f8090c9270 2023-02-09 06:03:09,573 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f1/69535fb5860f45d391f5f24885be123f as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/69535fb5860f45d391f5f24885be123f 2023-02-09 06:03:09,578 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/40b0ced009124de295b7e5ef3a9dc800, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,579 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f2/809be0c88168436aa5ab7a494653d528 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/809be0c88168436aa5ab7a494653d528 2023-02-09 06:03:09,582 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f1/e22e04a50f6e4a45aef8d5630ebcf4ee as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/e22e04a50f6e4a45aef8d5630ebcf4ee 2023-02-09 06:03:09,589 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/e22e04a50f6e4a45aef8d5630ebcf4ee, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,590 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f2/f94801481721468fbe3c12f8090c9270 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/f94801481721468fbe3c12f8090c9270 2023-02-09 06:03:09,596 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f2/c80e570b986a44918187d4a27ed12ee8 2023-02-09 06:03:09,600 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/809be0c88168436aa5ab7a494653d528, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,601 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/69535fb5860f45d391f5f24885be123f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,602 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d10b4f9dbd22ffe39dfd0ff87c38b6fa in 296ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,602 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f2/340ef70fb6d64e9dbd82253066612e09 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/340ef70fb6d64e9dbd82253066612e09 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/40b0ced009124de295b7e5ef3a9dc800] hfiles 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/40b0ced009124de295b7e5ef3a9dc800 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/809be0c88168436aa5ab7a494653d528] hfiles 2023-02-09 06:03:09,603 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/809be0c88168436aa5ab7a494653d528 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,606 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f1/bcfa1a0231b746fbb3e607e1879c80f2 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/bcfa1a0231b746fbb3e607e1879c80f2 2023-02-09 06:03:09,612 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/340ef70fb6d64e9dbd82253066612e09, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,613 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/f94801481721468fbe3c12f8090c9270, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,614 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1ec122195731eb943af0673fb30f7b2b in 318ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,614 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2f32e10b7da81f7bf0cf85083961a6d5 in 320ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1ec122195731eb943af0673fb30f7b2b: 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2f32e10b7da81f7bf0cf85083961a6d5: 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/e22e04a50f6e4a45aef8d5630ebcf4ee] hfiles 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/e22e04a50f6e4a45aef8d5630ebcf4ee for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/f94801481721468fbe3c12f8090c9270] hfiles 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/f94801481721468fbe3c12f8090c9270 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,620 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,621 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/69535fb5860f45d391f5f24885be123f] hfiles 2023-02-09 06:03:09,621 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/69535fb5860f45d391f5f24885be123f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,621 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/340ef70fb6d64e9dbd82253066612e09] hfiles 2023-02-09 06:03:09,621 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/340ef70fb6d64e9dbd82253066612e09 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,625 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/bcfa1a0231b746fbb3e607e1879c80f2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,626 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f2/c80e570b986a44918187d4a27ed12ee8 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/c80e570b986a44918187d4a27ed12ee8 2023-02-09 06:03:09,631 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. completed. 2023-02-09 06:03:09,632 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:09,632 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:03:09,632 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. started... 2023-02-09 06:03:09,635 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/c80e570b986a44918187d4a27ed12ee8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,636 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for dd03b135d141ff9e500396ed4cb9966d in 343ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,637 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dd03b135d141ff9e500396ed4cb9966d: 2023-02-09 06:03:09,637 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,637 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,637 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/bcfa1a0231b746fbb3e607e1879c80f2] hfiles 2023-02-09 06:03:09,637 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/bcfa1a0231b746fbb3e607e1879c80f2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,647 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3f2ddb856158359060e2511bb40ce530: 2023-02-09 06:03:09,647 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/c80e570b986a44918187d4a27ed12ee8] hfiles 2023-02-09 06:03:09,647 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/c80e570b986a44918187d4a27ed12ee8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,648 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,648 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,648 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:09,648 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. completed. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. started... 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. completed. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:09,653 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6bce83b18f225424b9461a90fe0a8f68 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:03:09,653 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. started... 2023-02-09 06:03:09,654 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 31ec182f145fee9b2fa8d74e1945e35e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:03:09,680 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. completed. 2023-02-09 06:03:09,680 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:09,680 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:03:09,680 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. started... 2023-02-09 06:03:09,680 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 08a04ea3aa886ab428bf1248b056eb38: 2023-02-09 06:03:09,681 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,681 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,681 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:09,681 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:09,684 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. completed. 2023-02-09 06:03:09,684 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:09,684 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:03:09,696 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f1/3a083a9c1cba48d2a806d305720a70c5 2023-02-09 06:03:09,708 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f1/2e211f2f863843628a4acccbd344b444 2023-02-09 06:03:09,715 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. completed. 2023-02-09 06:03:09,715 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:09,715 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:03:09,736 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f2/c4bd9522ffc64f9db678b9303e45d930 2023-02-09 06:03:09,748 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f1/2e211f2f863843628a4acccbd344b444 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/2e211f2f863843628a4acccbd344b444 2023-02-09 06:03:09,751 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f2/e2a064947b7c44f1a1f8cfb6a35d647c 2023-02-09 06:03:09,761 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/2e211f2f863843628a4acccbd344b444, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:09,761 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f1/3a083a9c1cba48d2a806d305720a70c5 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/3a083a9c1cba48d2a806d305720a70c5 2023-02-09 06:03:09,762 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f2/c4bd9522ffc64f9db678b9303e45d930 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/c4bd9522ffc64f9db678b9303e45d930 2023-02-09 06:03:09,771 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/3a083a9c1cba48d2a806d305720a70c5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,772 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f2/e2a064947b7c44f1a1f8cfb6a35d647c as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/e2a064947b7c44f1a1f8cfb6a35d647c 2023-02-09 06:03:09,773 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/c4bd9522ffc64f9db678b9303e45d930, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:09,774 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 31ec182f145fee9b2fa8d74e1945e35e in 120ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,774 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 31ec182f145fee9b2fa8d74e1945e35e: 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/2e211f2f863843628a4acccbd344b444] hfiles 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/2e211f2f863843628a4acccbd344b444 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/c4bd9522ffc64f9db678b9303e45d930] hfiles 2023-02-09 06:03:09,775 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/c4bd9522ffc64f9db678b9303e45d930 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,785 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/e2a064947b7c44f1a1f8cfb6a35d647c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,786 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6bce83b18f225424b9461a90fe0a8f68 in 133ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6bce83b18f225424b9461a90fe0a8f68: 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/3a083a9c1cba48d2a806d305720a70c5] hfiles 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/3a083a9c1cba48d2a806d305720a70c5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/e2a064947b7c44f1a1f8cfb6a35d647c] hfiles 2023-02-09 06:03:09,786 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/e2a064947b7c44f1a1f8cfb6a35d647c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,803 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. completed. 2023-02-09 06:03:09,803 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:09,803 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:03:09,804 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. completed. 2023-02-09 06:03:09,804 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:09,805 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:03:09,811 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:09,811 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:09,811 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:09,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:09,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:09,813 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 06:03:09,915 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f1/c78eb42246ba4f97b9267d096989336c 2023-02-09 06:03:09,915 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f1/984b9ee4d76e45799b30745df1326c56 2023-02-09 06:03:09,947 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f2/8901a08d14be44e8b081e9759fe847cf 2023-02-09 06:03:09,948 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f2/d65320a9fa7f4f619ea25e590f6d9e24 2023-02-09 06:03:09,956 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f1/c78eb42246ba4f97b9267d096989336c as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/c78eb42246ba4f97b9267d096989336c 2023-02-09 06:03:09,956 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f1/984b9ee4d76e45799b30745df1326c56 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/984b9ee4d76e45799b30745df1326c56 2023-02-09 06:03:09,961 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/c78eb42246ba4f97b9267d096989336c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,961 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/984b9ee4d76e45799b30745df1326c56, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:09,963 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f2/8901a08d14be44e8b081e9759fe847cf as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/8901a08d14be44e8b081e9759fe847cf 2023-02-09 06:03:09,963 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f2/d65320a9fa7f4f619ea25e590f6d9e24 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/d65320a9fa7f4f619ea25e590f6d9e24 2023-02-09 06:03:09,969 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/d65320a9fa7f4f619ea25e590f6d9e24, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:09,969 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/8901a08d14be44e8b081e9759fe847cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:09,970 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ec55c3edfc49ef841c2000d11245d19f in 677ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,970 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ec55c3edfc49ef841c2000d11245d19f: 2023-02-09 06:03:09,970 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/984b9ee4d76e45799b30745df1326c56] hfiles 2023-02-09 06:03:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/984b9ee4d76e45799b30745df1326c56 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/d65320a9fa7f4f619ea25e590f6d9e24] hfiles 2023-02-09 06:03:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/d65320a9fa7f4f619ea25e590f6d9e24 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,974 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c03e57d2c1d15d47053374a61af9790a in 678ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c03e57d2c1d15d47053374a61af9790a: 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/c78eb42246ba4f97b9267d096989336c] hfiles 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/c78eb42246ba4f97b9267d096989336c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/8901a08d14be44e8b081e9759fe847cf] hfiles 2023-02-09 06:03:09,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/8901a08d14be44e8b081e9759fe847cf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,984 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. completed. 2023-02-09 06:03:09,984 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 06:03:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35721,1675922586349' in zk 2023-02-09 06:03:09,990 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:09,991 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 06:03:09,991 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:09,991 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 06:03:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:09,992 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. completed. 2023-02-09 06:03:09,992 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:09,992 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:03:09,992 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:03:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:09,992 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,993 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 06:03:09,993 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,36841,1675922586312' in zk 2023-02-09 06:03:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,995 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,995 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 06:03:09,996 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:09,996 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 06:03:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35721,1675922586349': 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35721,1675922586349' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:09,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:09,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:09,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:10,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,36841,1675922586312': 2023-02-09 06:03:10,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36841,1675922586312' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:10,002 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-09 06:03:10,002 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:10,002 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:10,002 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,002 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:10,004 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:10,004 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:10,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:10,005 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,005 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,007 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:10,008 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,013 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,013 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:10,013 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:10,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:10,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:10,013 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,014 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,014 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,014 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:10,014 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:10,013 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:10,014 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:10,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,015 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,015 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:10,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:10,016 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,016 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-09 06:03:10,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,083 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:10,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675922589172Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675922590015 (+843 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675922590016 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675922590027 (+11 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675922590046 (+19 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675922590082 (+36 ms) 2023-02-09 06:03:10,085 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:10,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 912 msec 2023-02-09 06:03:10,313 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:10,313 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:10,313 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:10,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:10,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:10,315 INFO [Listener at localhost/34951] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:10,315 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:10,315 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:10,320 INFO [Listener at localhost/34951] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:10,529 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:10,584 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36841] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:10,586 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:10,679 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:10,684 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:10,685 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:10,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:10,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 06:03:10,692 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 06:03:10,692 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:10,693 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 06:03:10,693 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 06:03:10,694 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:10,694 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:10,696 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:10,696 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:10,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:10,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:10,696 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:10,697 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,697 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:10,698 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:03:10,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:03:10,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:03:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:03:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:03:10,701 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:10,701 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:03:10,702 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:03:10,703 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:10,703 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. started... 2023-02-09 06:03:10,703 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec55c3edfc49ef841c2000d11245d19f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:03:10,708 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:10,709 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. started... 2023-02-09 06:03:10,709 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:10,709 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. started... 2023-02-09 06:03:10,709 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing dd03b135d141ff9e500396ed4cb9966d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,709 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2f32e10b7da81f7bf0cf85083961a6d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,709 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:10,710 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. started... 2023-02-09 06:03:10,710 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1ec122195731eb943af0673fb30f7b2b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:03:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:10,710 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:10,710 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. started... 2023-02-09 06:03:10,710 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d10b4f9dbd22ffe39dfd0ff87c38b6fa 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:03:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:10,714 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:10,714 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. started... 2023-02-09 06:03:10,714 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c03e57d2c1d15d47053374a61af9790a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,756 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f1/08407380b2384a6ab133329f7c002e28 2023-02-09 06:03:10,770 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f1/477258bed6e84a13901ffdf44366771b 2023-02-09 06:03:10,770 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f1/a9e8a16706cd473cbec92776e32ee014 2023-02-09 06:03:10,784 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f1/86834739fdb44df4a91a9fd511038fb1 2023-02-09 06:03:10,796 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f1/e884a8e9a2ff48b4b1b7afe417b84bde 2023-02-09 06:03:10,810 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f1/0191c29ec8f04655a6e884ac376cf677 2023-02-09 06:03:10,832 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f2/deaa5203e67d4486a9e410e0786305d8 2023-02-09 06:03:10,839 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f1/a9e8a16706cd473cbec92776e32ee014 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/a9e8a16706cd473cbec92776e32ee014 2023-02-09 06:03:10,844 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/a9e8a16706cd473cbec92776e32ee014, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,845 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/.tmp/f2/deaa5203e67d4486a9e410e0786305d8 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/deaa5203e67d4486a9e410e0786305d8 2023-02-09 06:03:10,850 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/deaa5203e67d4486a9e410e0786305d8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,852 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2f32e10b7da81f7bf0cf85083961a6d5 in 143ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,852 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2f32e10b7da81f7bf0cf85083961a6d5: 2023-02-09 06:03:10,852 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:10,856 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:03:10,856 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. started... 2023-02-09 06:03:10,856 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6bce83b18f225424b9461a90fe0a8f68 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:10,856 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f2/5efc55e89717480bb4ae6e896c56035f 2023-02-09 06:03:10,874 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f2/b06c7b0bd5aa447f827d06f7e0036389 2023-02-09 06:03:10,876 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f2/d8929628acac478c95f46c872eb9775a 2023-02-09 06:03:10,877 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f1/477258bed6e84a13901ffdf44366771b as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/477258bed6e84a13901ffdf44366771b 2023-02-09 06:03:10,882 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f1/86834739fdb44df4a91a9fd511038fb1 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/86834739fdb44df4a91a9fd511038fb1 2023-02-09 06:03:10,885 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/477258bed6e84a13901ffdf44366771b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:10,886 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/.tmp/f2/5efc55e89717480bb4ae6e896c56035f as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/5efc55e89717480bb4ae6e896c56035f 2023-02-09 06:03:10,889 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f2/741b5f3eef3c44b098fa17fbfb6765ab 2023-02-09 06:03:10,889 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f2/9a5fbf8e016143e49d438de31715677c 2023-02-09 06:03:10,893 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/86834739fdb44df4a91a9fd511038fb1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,894 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f1/08407380b2384a6ab133329f7c002e28 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/08407380b2384a6ab133329f7c002e28 2023-02-09 06:03:10,895 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/.tmp/f2/b06c7b0bd5aa447f827d06f7e0036389 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/b06c7b0bd5aa447f827d06f7e0036389 2023-02-09 06:03:10,895 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/5efc55e89717480bb4ae6e896c56035f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:10,896 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ec55c3edfc49ef841c2000d11245d19f in 193ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,897 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec55c3edfc49ef841c2000d11245d19f: 2023-02-09 06:03:10,897 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:10,899 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f1/e884a8e9a2ff48b4b1b7afe417b84bde as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/e884a8e9a2ff48b4b1b7afe417b84bde 2023-02-09 06:03:10,900 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f1/0191c29ec8f04655a6e884ac376cf677 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/0191c29ec8f04655a6e884ac376cf677 2023-02-09 06:03:10,903 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/b06c7b0bd5aa447f827d06f7e0036389, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,904 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/08407380b2384a6ab133329f7c002e28, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,905 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c03e57d2c1d15d47053374a61af9790a in 191ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c03e57d2c1d15d47053374a61af9790a: 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. started... 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 08a04ea3aa886ab428bf1248b056eb38: 2023-02-09 06:03:10,905 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:10,905 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:10,905 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:10,906 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/.tmp/f2/d8929628acac478c95f46c872eb9775a as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/d8929628acac478c95f46c872eb9775a 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. started... 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f2ddb856158359060e2511bb40ce530: 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:10,908 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. started... 2023-02-09 06:03:10,909 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ec182f145fee9b2fa8d74e1945e35e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:03:10,909 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:03:10,909 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:10,911 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/e884a8e9a2ff48b4b1b7afe417b84bde, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,912 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/.tmp/f2/9a5fbf8e016143e49d438de31715677c as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/9a5fbf8e016143e49d438de31715677c 2023-02-09 06:03:10,913 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/0191c29ec8f04655a6e884ac376cf677, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,914 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/.tmp/f2/741b5f3eef3c44b098fa17fbfb6765ab as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/741b5f3eef3c44b098fa17fbfb6765ab 2023-02-09 06:03:10,927 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f1/deb05529e66a4daaa5598b51465f64da 2023-02-09 06:03:10,929 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/d8929628acac478c95f46c872eb9775a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,930 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for dd03b135d141ff9e500396ed4cb9966d in 221ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,931 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for dd03b135d141ff9e500396ed4cb9966d: 2023-02-09 06:03:10,931 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:10,934 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/741b5f3eef3c44b098fa17fbfb6765ab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,935 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d10b4f9dbd22ffe39dfd0ff87c38b6fa in 225ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,935 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: 2023-02-09 06:03:10,935 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:10,935 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:10,943 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/9a5fbf8e016143e49d438de31715677c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,944 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1ec122195731eb943af0673fb30f7b2b in 234ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,944 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1ec122195731eb943af0673fb30f7b2b: 2023-02-09 06:03:10,944 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:10,952 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f1/54987a34158544448ad3d706425eeaf6 2023-02-09 06:03:10,968 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f2/44df1bb7a345489297b7f006f77b98b7 2023-02-09 06:03:10,974 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f1/deb05529e66a4daaa5598b51465f64da as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/deb05529e66a4daaa5598b51465f64da 2023-02-09 06:03:10,976 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f2/3f0ddab211ea47f2bd511c1d1ffeae74 2023-02-09 06:03:10,980 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/deb05529e66a4daaa5598b51465f64da, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,981 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/.tmp/f2/44df1bb7a345489297b7f006f77b98b7 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/44df1bb7a345489297b7f006f77b98b7 2023-02-09 06:03:10,984 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f1/54987a34158544448ad3d706425eeaf6 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/54987a34158544448ad3d706425eeaf6 2023-02-09 06:03:10,990 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/44df1bb7a345489297b7f006f77b98b7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:10,990 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/54987a34158544448ad3d706425eeaf6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:10,991 INFO [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6bce83b18f225424b9461a90fe0a8f68 in 135ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,991 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6bce83b18f225424b9461a90fe0a8f68: 2023-02-09 06:03:10,991 DEBUG [rs(jenkins-hbase4.apache.org,36841,1675922586312)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36841,1675922586312' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:10,992 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/.tmp/f2/3f0ddab211ea47f2bd511c1d1ffeae74 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/3f0ddab211ea47f2bd511c1d1ffeae74 2023-02-09 06:03:10,993 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:10,994 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:10,994 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:10,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36841,1675922586312' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 06:03:10,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@131ba83c[Count = 1] remaining members to acquire global barrier 2023-02-09 06:03:10,998 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/3f0ddab211ea47f2bd511c1d1ffeae74, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:10,999 INFO [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 31ec182f145fee9b2fa8d74e1945e35e in 90ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:10,999 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ec182f145fee9b2fa8d74e1945e35e: 2023-02-09 06:03:10,999 DEBUG [rs(jenkins-hbase4.apache.org,35721,1675922586349)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:10,999 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35721,1675922586349' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,001 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:11,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35721,1675922586349' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 06:03:11,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@131ba83c[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:11,004 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 06:03:11,004 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:11,005 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35721,1675922586349' in zk 2023-02-09 06:03:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36841,1675922586312' in zk 2023-02-09 06:03:11,005 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,005 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:11,008 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,008 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,008 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:11,008 DEBUG [member: 'jenkins-hbase4.apache.org,35721,1675922586349' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:11,009 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,009 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:11,009 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,36841,1675922586312' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35721,1675922586349': 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35721,1675922586349' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36841,1675922586312': 2023-02-09 06:03:11,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36841,1675922586312' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 06:03:11,016 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 06:03:11,016 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:11,016 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:11,016 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 06:03:11,016 INFO [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:11,017 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,017 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:11,017 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:11,017 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,018 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:11,018 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:11,018 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,020 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:11,021 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:11,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:11,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:11,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:11,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 06:03:11,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:11,023 DEBUG [(jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:11,023 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:11,025 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:11,125 DEBUG [Listener at localhost/34951] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:11,126 INFO [Listener at localhost/34951] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:11,126 INFO [Listener at localhost/34951] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33743] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:11,127 INFO [Listener at localhost/34951] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:11,128 DEBUG [Listener at localhost/34951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cb03327 to 127.0.0.1:52744 2023-02-09 06:03:11,129 DEBUG [Listener at localhost/34951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,129 DEBUG [Listener at localhost/34951] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:11,129 DEBUG [Listener at localhost/34951] util.JVMClusterUtil(257): Found active master hash=1536591087, stopped=false 2023-02-09 06:03:11,129 INFO [Listener at localhost/34951] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:11,132 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:11,132 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:11,132 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:11,132 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:11,132 INFO [Listener at localhost/34951] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:11,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:11,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:11,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:11,133 DEBUG [Listener at localhost/34951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2180efc5 to 127.0.0.1:52744 2023-02-09 06:03:11,134 DEBUG [Listener at localhost/34951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,134 INFO [Listener at localhost/34951] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36841,1675922586312' ***** 2023-02-09 06:03:11,134 INFO [Listener at localhost/34951] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:11,134 INFO [Listener at localhost/34951] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35721,1675922586349' ***** 2023-02-09 06:03:11,134 INFO [RS:0;jenkins-hbase4:36841] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:11,134 INFO [Listener at localhost/34951] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:11,134 INFO [RS:0;jenkins-hbase4:36841] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:11,134 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:11,134 INFO [RS:0;jenkins-hbase4:36841] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:11,134 INFO [RS:1;jenkins-hbase4:35721] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:11,136 INFO [RS:1;jenkins-hbase4:35721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:11,136 INFO [RS:1;jenkins-hbase4:35721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:11,136 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:11,135 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:11,136 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:11,136 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:11,136 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:11,136 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:11,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dd03b135d141ff9e500396ed4cb9966d, disabling compactions & flushes 2023-02-09 06:03:11,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ec55c3edfc49ef841c2000d11245d19f, disabling compactions & flushes 2023-02-09 06:03:11,136 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for 031a80b65f1e510cd257bcf65fb0b3b5 2023-02-09 06:03:11,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:11,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:11,137 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:11,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:11,137 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:11,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:11,137 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:11,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. after waiting 0 ms 2023-02-09 06:03:11,137 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:11,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:11,138 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(3304): Received CLOSE for 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:11,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. after waiting 0 ms 2023-02-09 06:03:11,138 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:11,138 DEBUG [RS:1;jenkins-hbase4:35721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00f1f754 to 127.0.0.1:52744 2023-02-09 06:03:11,138 DEBUG [RS:1;jenkins-hbase4:35721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,138 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 06:03:11,138 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1479): Online Regions={ec55c3edfc49ef841c2000d11245d19f=testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f., 1ec122195731eb943af0673fb30f7b2b=testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b., 031a80b65f1e510cd257bcf65fb0b3b5=hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5., d10b4f9dbd22ffe39dfd0ff87c38b6fa=testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa., 3f2ddb856158359060e2511bb40ce530=testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530., 31ec182f145fee9b2fa8d74e1945e35e=testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.} 2023-02-09 06:03:11,138 DEBUG [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1505): Waiting on 031a80b65f1e510cd257bcf65fb0b3b5, 1ec122195731eb943af0673fb30f7b2b, 31ec182f145fee9b2fa8d74e1945e35e, 3f2ddb856158359060e2511bb40ce530, d10b4f9dbd22ffe39dfd0ff87c38b6fa, ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:11,138 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,140 DEBUG [RS:0;jenkins-hbase4:36841] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00a1aa2f to 127.0.0.1:52744 2023-02-09 06:03:11,141 DEBUG [RS:0;jenkins-hbase4:36841] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,141 INFO [RS:0;jenkins-hbase4:36841] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:11,141 INFO [RS:0;jenkins-hbase4:36841] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:11,141 INFO [RS:0;jenkins-hbase4:36841] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:11,141 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:11,143 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 06:03:11,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:11,144 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1479): Online Regions={dd03b135d141ff9e500396ed4cb9966d=testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d., 2f32e10b7da81f7bf0cf85083961a6d5=testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5., c03e57d2c1d15d47053374a61af9790a=testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a., 1588230740=hbase:meta,,1.1588230740, 6bce83b18f225424b9461a90fe0a8f68=testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68., 08a04ea3aa886ab428bf1248b056eb38=testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.} 2023-02-09 06:03:11,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:11,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:11,145 DEBUG [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1505): Waiting on 08a04ea3aa886ab428bf1248b056eb38, 1588230740, 2f32e10b7da81f7bf0cf85083961a6d5, 6bce83b18f225424b9461a90fe0a8f68, c03e57d2c1d15d47053374a61af9790a, dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:11,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:11,146 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:11,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-09 06:03:11,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:11,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ec55c3edfc49ef841c2000d11245d19f: Waiting for close lock at 1675922591136Running coprocessor pre-close hooks at 1675922591136Disabling compacts and flushes for region at 1675922591136Disabling writes for close at 1675922591138 (+2 ms)Writing region close event to WAL at 1675922591145 (+7 ms)Running coprocessor post-close hooks at 1675922591151 (+6 ms)Closed at 1675922591152 (+1 ms) 2023-02-09 06:03:11,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:11,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ec122195731eb943af0673fb30f7b2b, disabling compactions & flushes 2023-02-09 06:03:11,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:11,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dd03b135d141ff9e500396ed4cb9966d: Waiting for close lock at 1675922591136Running coprocessor pre-close hooks at 1675922591136Disabling compacts and flushes for region at 1675922591136Disabling writes for close at 1675922591138 (+2 ms)Writing region close event to WAL at 1675922591145 (+7 ms)Running coprocessor post-close hooks at 1675922591152 (+7 ms)Closed at 1675922591153 (+1 ms) 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. after waiting 0 ms 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2f32e10b7da81f7bf0cf85083961a6d5, disabling compactions & flushes 2023-02-09 06:03:11,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. after waiting 0 ms 2023-02-09 06:03:11,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:11,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/.tmp/info/501ad92725e045819a946f95a107c1c6 2023-02-09 06:03:11,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:11,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ec122195731eb943af0673fb30f7b2b: Waiting for close lock at 1675922591152Running coprocessor pre-close hooks at 1675922591152Disabling compacts and flushes for region at 1675922591152Disabling writes for close at 1675922591153 (+1 ms)Writing region close event to WAL at 1675922591166 (+13 ms)Running coprocessor post-close hooks at 1675922591174 (+8 ms)Closed at 1675922591175 (+1 ms) 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:11,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 031a80b65f1e510cd257bcf65fb0b3b5, disabling compactions & flushes 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2f32e10b7da81f7bf0cf85083961a6d5: Waiting for close lock at 1675922591153Running coprocessor pre-close hooks at 1675922591153Disabling compacts and flushes for region at 1675922591153Disabling writes for close at 1675922591153Writing region close event to WAL at 1675922591166 (+13 ms)Running coprocessor post-close hooks at 1675922591175 (+9 ms)Closed at 1675922591176 (+1 ms) 2023-02-09 06:03:11,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. after waiting 0 ms 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c03e57d2c1d15d47053374a61af9790a, disabling compactions & flushes 2023-02-09 06:03:11,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 031a80b65f1e510cd257bcf65fb0b3b5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:11,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:11,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:11,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. after waiting 0 ms 2023-02-09 06:03:11,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:11,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c03e57d2c1d15d47053374a61af9790a: Waiting for close lock at 1675922591176Running coprocessor pre-close hooks at 1675922591176Disabling compacts and flushes for region at 1675922591176Disabling writes for close at 1675922591177 (+1 ms)Writing region close event to WAL at 1675922591178 (+1 ms)Running coprocessor post-close hooks at 1675922591184 (+6 ms)Closed at 1675922591188 (+4 ms) 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6bce83b18f225424b9461a90fe0a8f68, disabling compactions & flushes 2023-02-09 06:03:11,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. after waiting 0 ms 2023-02-09 06:03:11,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:11,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/.tmp/info/35749569171e4bd596d3c4b17a1723b9 2023-02-09 06:03:11,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/.tmp/table/13d9533c95a64dca98ab05ea75dd2abd 2023-02-09 06:03:11,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6bce83b18f225424b9461a90fe0a8f68: Waiting for close lock at 1675922591189Running coprocessor pre-close hooks at 1675922591189Disabling compacts and flushes for region at 1675922591189Disabling writes for close at 1675922591189Writing region close event to WAL at 1675922591195 (+6 ms)Running coprocessor post-close hooks at 1675922591200 (+5 ms)Closed at 1675922591201 (+1 ms) 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08a04ea3aa886ab428bf1248b056eb38, disabling compactions & flushes 2023-02-09 06:03:11,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. after waiting 0 ms 2023-02-09 06:03:11,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:11,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/.tmp/info/35749569171e4bd596d3c4b17a1723b9 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/info/35749569171e4bd596d3c4b17a1723b9 2023-02-09 06:03:11,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:11,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:11,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08a04ea3aa886ab428bf1248b056eb38: Waiting for close lock at 1675922591201Running coprocessor pre-close hooks at 1675922591201Disabling compacts and flushes for region at 1675922591201Disabling writes for close at 1675922591201Writing region close event to WAL at 1675922591202 (+1 ms)Running coprocessor post-close hooks at 1675922591205 (+3 ms)Closed at 1675922591206 (+1 ms) 2023-02-09 06:03:11,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:11,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/.tmp/info/501ad92725e045819a946f95a107c1c6 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/info/501ad92725e045819a946f95a107c1c6 2023-02-09 06:03:11,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/info/35749569171e4bd596d3c4b17a1723b9, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:11,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 031a80b65f1e510cd257bcf65fb0b3b5 in 35ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:11,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 06:03:11,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/info/501ad92725e045819a946f95a107c1c6, entries=110, sequenceid=32, filesize=18.7 K 2023-02-09 06:03:11,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/.tmp/table/13d9533c95a64dca98ab05ea75dd2abd as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/table/13d9533c95a64dca98ab05ea75dd2abd 2023-02-09 06:03:11,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/namespace/031a80b65f1e510cd257bcf65fb0b3b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:11,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:11,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 031a80b65f1e510cd257bcf65fb0b3b5: Waiting for close lock at 1675922591176Running coprocessor pre-close hooks at 1675922591176Disabling compacts and flushes for region at 1675922591176Disabling writes for close at 1675922591176Obtaining lock to block concurrent updates at 1675922591176Preparing flush snapshotting stores in 031a80b65f1e510cd257bcf65fb0b3b5 at 1675922591176Finished memstore snapshotting hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922591177 (+1 ms)Flushing stores of hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. at 1675922591177Flushing 031a80b65f1e510cd257bcf65fb0b3b5/info: creating writer at 1675922591177Flushing 031a80b65f1e510cd257bcf65fb0b3b5/info: appending metadata at 1675922591180 (+3 ms)Flushing 031a80b65f1e510cd257bcf65fb0b3b5/info: closing flushed file at 1675922591180Flushing 031a80b65f1e510cd257bcf65fb0b3b5/info: reopening flushed file at 1675922591204 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 031a80b65f1e510cd257bcf65fb0b3b5 in 35ms, sequenceid=6, compaction requested=false at 1675922591211 (+7 ms)Writing region close event to WAL at 1675922591212 (+1 ms)Running coprocessor post-close hooks at 1675922591216 (+4 ms)Closed at 1675922591217 (+1 ms) 2023-02-09 06:03:11,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922587100.031a80b65f1e510cd257bcf65fb0b3b5. 2023-02-09 06:03:11,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d10b4f9dbd22ffe39dfd0ff87c38b6fa, disabling compactions & flushes 2023-02-09 06:03:11,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:11,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:11,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. after waiting 0 ms 2023-02-09 06:03:11,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:11,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/table/13d9533c95a64dca98ab05ea75dd2abd, entries=4, sequenceid=32, filesize=4.8 K 2023-02-09 06:03:11,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false 2023-02-09 06:03:11,222 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 06:03:11,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Waiting for close lock at 1675922591218Running coprocessor pre-close hooks at 1675922591218Disabling compacts and flushes for region at 1675922591218Disabling writes for close at 1675922591218Writing region close event to WAL at 1675922591219 (+1 ms)Running coprocessor post-close hooks at 1675922591223 (+4 ms)Closed at 1675922591223 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f2ddb856158359060e2511bb40ce530, disabling compactions & flushes 2023-02-09 06:03:11,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. after waiting 0 ms 2023-02-09 06:03:11,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:11,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:11,228 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:11,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:11,229 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-09 06:03:11,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f2ddb856158359060e2511bb40ce530: Waiting for close lock at 1675922591223Running coprocessor pre-close hooks at 1675922591223Disabling compacts and flushes for region at 1675922591223Disabling writes for close at 1675922591223Writing region close event to WAL at 1675922591225 (+2 ms)Running coprocessor post-close hooks at 1675922591230 (+5 ms)Closed at 1675922591230 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31ec182f145fee9b2fa8d74e1945e35e, disabling compactions & flushes 2023-02-09 06:03:11,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. after waiting 0 ms 2023-02-09 06:03:11,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922591144Running coprocessor pre-close hooks at 1675922591144Disabling compacts and flushes for region at 1675922591144Disabling writes for close at 1675922591146 (+2 ms)Obtaining lock to block concurrent updates at 1675922591146Preparing flush snapshotting stores in 1588230740 at 1675922591146Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675922591146Flushing stores of hbase:meta,,1.1588230740 at 1675922591146Flushing 1588230740/info: creating writer at 1675922591146Flushing 1588230740/info: appending metadata at 1675922591151 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675922591151Flushing 1588230740/table: creating writer at 1675922591181 (+30 ms)Flushing 1588230740/table: appending metadata at 1675922591189 (+8 ms)Flushing 1588230740/table: closing flushed file at 1675922591189Flushing 1588230740/info: reopening flushed file at 1675922591207 (+18 ms)Flushing 1588230740/table: reopening flushed file at 1675922591214 (+7 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false at 1675922591222 (+8 ms)Writing region close event to WAL at 1675922591226 (+4 ms)Running coprocessor post-close hooks at 1675922591230 (+4 ms)Closed at 1675922591230 2023-02-09 06:03:11,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:11,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:11,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:11,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31ec182f145fee9b2fa8d74e1945e35e: Waiting for close lock at 1675922591230Running coprocessor pre-close hooks at 1675922591230Disabling compacts and flushes for region at 1675922591230Disabling writes for close at 1675922591230Writing region close event to WAL at 1675922591231 (+1 ms)Running coprocessor post-close hooks at 1675922591236 (+5 ms)Closed at 1675922591236 2023-02-09 06:03:11,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:11,339 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35721,1675922586349; all regions closed. 2023-02-09 06:03:11,345 DEBUG [RS:1;jenkins-hbase4:35721] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs 2023-02-09 06:03:11,345 INFO [RS:1;jenkins-hbase4:35721] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35721%2C1675922586349:(num 1675922587508) 2023-02-09 06:03:11,345 DEBUG [RS:1;jenkins-hbase4:35721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,345 INFO [RS:1;jenkins-hbase4:35721] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:11,345 INFO [RS:1;jenkins-hbase4:35721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:11,346 INFO [RS:1;jenkins-hbase4:35721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:11,346 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:11,346 INFO [RS:1;jenkins-hbase4:35721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:11,346 INFO [RS:1;jenkins-hbase4:35721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:11,346 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36841,1675922586312; all regions closed. 2023-02-09 06:03:11,347 INFO [RS:1;jenkins-hbase4:35721] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35721 2023-02-09 06:03:11,353 DEBUG [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs 2023-02-09 06:03:11,353 INFO [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36841%2C1675922586312.meta:.meta(num 1675922587014) 2023-02-09 06:03:11,356 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:11,356 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,356 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:11,356 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35721,1675922586349 2023-02-09 06:03:11,356 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33eb05d7 rejected from java.util.concurrent.ThreadPoolExecutor@37d49772[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,356 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:11,356 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28403158 rejected from java.util.concurrent.ThreadPoolExecutor@37d49772[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,357 DEBUG [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/oldWALs 2023-02-09 06:03:11,357 INFO [RS:0;jenkins-hbase4:36841] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36841%2C1675922586312:(num 1675922587845) 2023-02-09 06:03:11,357 DEBUG [RS:0;jenkins-hbase4:36841] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,357 INFO [RS:0;jenkins-hbase4:36841] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:11,357 INFO [RS:0;jenkins-hbase4:36841] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:11,357 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:11,358 INFO [RS:0;jenkins-hbase4:36841] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36841 2023-02-09 06:03:11,360 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35721,1675922586349] 2023-02-09 06:03:11,360 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35721,1675922586349; numProcessing=1 2023-02-09 06:03:11,361 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:11,361 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36841,1675922586312 2023-02-09 06:03:11,361 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e707889 rejected from java.util.concurrent.ThreadPoolExecutor@a4fed9f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,361 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35721,1675922586349 already deleted, retry=false 2023-02-09 06:03:11,361 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35721,1675922586349 expired; onlineServers=1 2023-02-09 06:03:11,363 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36841,1675922586312] 2023-02-09 06:03:11,363 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36841,1675922586312; numProcessing=2 2023-02-09 06:03:11,364 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36841,1675922586312 already deleted, retry=false 2023-02-09 06:03:11,364 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36841,1675922586312 expired; onlineServers=0 2023-02-09 06:03:11,364 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33743,1675922586252' ***** 2023-02-09 06:03:11,364 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:11,365 DEBUG [M:0;jenkins-hbase4:33743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aab8ed4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:11,365 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33743,1675922586252 2023-02-09 06:03:11,365 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33743,1675922586252; all regions closed. 2023-02-09 06:03:11,365 DEBUG [M:0;jenkins-hbase4:33743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:11,365 DEBUG [M:0;jenkins-hbase4:33743] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:11,365 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:11,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922586624] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922586624,5,FailOnTimeoutGroup] 2023-02-09 06:03:11,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922586629] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922586629,5,FailOnTimeoutGroup] 2023-02-09 06:03:11,365 DEBUG [M:0;jenkins-hbase4:33743] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:11,367 INFO [M:0;jenkins-hbase4:33743] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:11,367 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:11,367 INFO [M:0;jenkins-hbase4:33743] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:11,367 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:11,367 INFO [M:0;jenkins-hbase4:33743] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:11,367 DEBUG [M:0;jenkins-hbase4:33743] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:11,367 INFO [M:0;jenkins-hbase4:33743] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:11,367 ERROR [M:0;jenkins-hbase4:33743] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:11,368 INFO [M:0;jenkins-hbase4:33743] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:11,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:11,368 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:11,368 DEBUG [M:0;jenkins-hbase4:33743] zookeeper.ZKUtil(398): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:11,368 WARN [M:0;jenkins-hbase4:33743] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:11,368 INFO [M:0;jenkins-hbase4:33743] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:11,370 INFO [M:0;jenkins-hbase4:33743] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:11,370 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:11,370 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:11,370 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:11,370 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:11,370 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:11,370 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-09 06:03:11,382 INFO [M:0;jenkins-hbase4:33743] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b32845c3cba642abb2fa69089142a005 2023-02-09 06:03:11,387 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b32845c3cba642abb2fa69089142a005 as hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b32845c3cba642abb2fa69089142a005 2023-02-09 06:03:11,391 INFO [M:0;jenkins-hbase4:33743] regionserver.HStore(1080): Added hdfs://localhost:41121/user/jenkins/test-data/05ab910c-30fb-67da-e6e0-5e86d3459c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b32845c3cba642abb2fa69089142a005, entries=31, sequenceid=218, filesize=9.0 K 2023-02-09 06:03:11,392 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-09 06:03:11,393 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:11,393 DEBUG [M:0;jenkins-hbase4:33743] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922591370Disabling compacts and flushes for region at 1675922591370Disabling writes for close at 1675922591370Obtaining lock to block concurrent updates at 1675922591370Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922591370Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675922591370Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922591371 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922591371Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922591374 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922591375 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922591388 (+13 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false at 1675922591392 (+4 ms)Writing region close event to WAL at 1675922591393 (+1 ms)Closed at 1675922591393 2023-02-09 06:03:11,397 INFO [M:0;jenkins-hbase4:33743] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:11,397 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:11,398 INFO [M:0;jenkins-hbase4:33743] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33743 2023-02-09 06:03:11,402 DEBUG [M:0;jenkins-hbase4:33743] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33743,1675922586252 already deleted, retry=false 2023-02-09 06:03:11,634 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,634 INFO [M:0;jenkins-hbase4:33743] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33743,1675922586252; zookeeper connection closed. 2023-02-09 06:03:11,635 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6146b5ca rejected from java.util.concurrent.ThreadPoolExecutor@65793d3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,636 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): master:33743-0x10037ad242a0000, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,636 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45ad8eb2 rejected from java.util.concurrent.ThreadPoolExecutor@65793d3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,735 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,735 INFO [RS:0;jenkins-hbase4:36841] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36841,1675922586312; zookeeper connection closed. 2023-02-09 06:03:11,735 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7371154a rejected from java.util.concurrent.ThreadPoolExecutor@a4fed9f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,735 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:36841-0x10037ad242a0001, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,735 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ddf8185] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ddf8185 2023-02-09 06:03:11,735 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b1ea6ce rejected from java.util.concurrent.ThreadPoolExecutor@a4fed9f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,835 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,835 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50123c22 rejected from java.util.concurrent.ThreadPoolExecutor@37d49772[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,835 DEBUG [Listener at localhost/34951-EventThread] zookeeper.ZKWatcher(600): regionserver:35721-0x10037ad242a0002, quorum=127.0.0.1:52744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:11,835 ERROR [Listener at localhost/34951-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b9ac955 rejected from java.util.concurrent.ThreadPoolExecutor@37d49772[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:11,836 INFO [RS:1;jenkins-hbase4:35721] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35721,1675922586349; zookeeper connection closed. 2023-02-09 06:03:11,864 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37eb8cad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37eb8cad 2023-02-09 06:03:11,865 INFO [Listener at localhost/34951] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:11,959 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop-2941865101247106083.jar 2023-02-09 06:03:11,964 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675922589126 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:11,964 DEBUG [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:11,965 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(239): region to add: 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=1ec122195731eb943af0673fb30f7b2b as 1ec122195731eb943af0673fb30f7b2b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=ec55c3edfc49ef841c2000d11245d19f as ec55c3edfc49ef841c2000d11245d19f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=dd03b135d141ff9e500396ed4cb9966d as dd03b135d141ff9e500396ed4cb9966d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=2f32e10b7da81f7bf0cf85083961a6d5 as 2f32e10b7da81f7bf0cf85083961a6d5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=c03e57d2c1d15d47053374a61af9790a as c03e57d2c1d15d47053374a61af9790a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=d10b4f9dbd22ffe39dfd0ff87c38b6fa as d10b4f9dbd22ffe39dfd0ff87c38b6fa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,966 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=3f2ddb856158359060e2511bb40ce530 as 3f2ddb856158359060e2511bb40ce530 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,967 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=6bce83b18f225424b9461a90fe0a8f68 as 6bce83b18f225424b9461a90fe0a8f68 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,967 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=08a04ea3aa886ab428bf1248b056eb38 as 08a04ea3aa886ab428bf1248b056eb38 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,967 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(585): clone region=31ec182f145fee9b2fa8d74e1945e35e as 31ec182f145fee9b2fa8d74e1945e35e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 06:03:11,967 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ec122195731eb943af0673fb30f7b2b, NAME => 'testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,968 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => dd03b135d141ff9e500396ed4cb9966d, NAME => 'testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 6bce83b18f225424b9461a90fe0a8f68, NAME => 'testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2f32e10b7da81f7bf0cf85083961a6d5, NAME => 'testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => ec55c3edfc49ef841c2000d11245d19f, NAME => 'testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3f2ddb856158359060e2511bb40ce530, NAME => 'testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => d10b4f9dbd22ffe39dfd0ff87c38b6fa, NAME => 'testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,969 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c03e57d2c1d15d47053374a61af9790a, NAME => 'testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:11,992 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:11,992 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e22e04a50f6e4a45aef8d5630ebcf4ee from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:11,996 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:11,997 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 69535fb5860f45d391f5f24885be123f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,003 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,004 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c78eb42246ba4f97b9267d096989336c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,004 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 340ef70fb6d64e9dbd82253066612e09 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,008 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,008 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bcfa1a0231b746fbb3e607e1879c80f2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,016 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f94801481721468fbe3c12f8090c9270 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,022 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8901a08d14be44e8b081e9759fe847cf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3f2ddb856158359060e2511bb40ce530, disabling compactions & flushes 2023-02-09 06:03:12,022 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. after waiting 0 ms 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,022 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3f2ddb856158359060e2511bb40ce530: Waiting for close lock at 1675922592022Disabling compacts and flushes for region at 1675922592022Disabling writes for close at 1675922592022Writing region close event to WAL at 1675922592022Closed at 1675922592022 2023-02-09 06:03:12,022 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c80e570b986a44918187d4a27ed12ee8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,022 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1ec122195731eb943af0673fb30f7b2b, disabling compactions & flushes 2023-02-09 06:03:12,023 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:12,023 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 08a04ea3aa886ab428bf1248b056eb38, NAME => 'testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:12,023 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,023 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:12,023 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. after waiting 0 ms 2023-02-09 06:03:12,023 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:12,023 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:12,023 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1ec122195731eb943af0673fb30f7b2b: Waiting for close lock at 1675922592022Disabling compacts and flushes for region at 1675922592022Disabling writes for close at 1675922592023 (+1 ms)Writing region close event to WAL at 1675922592023Closed at 1675922592023 2023-02-09 06:03:12,024 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 31ec182f145fee9b2fa8d74e1945e35e, NAME => 'testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:12,024 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 984b9ee4d76e45799b30745df1326c56 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,027 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,027 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 40b0ced009124de295b7e5ef3a9dc800 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c03e57d2c1d15d47053374a61af9790a, disabling compactions & flushes 2023-02-09 06:03:12,030 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing dd03b135d141ff9e500396ed4cb9966d, disabling compactions & flushes 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:12,030 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. after waiting 0 ms 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:12,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:12,030 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:12,031 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. after waiting 0 ms 2023-02-09 06:03:12,031 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c03e57d2c1d15d47053374a61af9790a: Waiting for close lock at 1675922592030Disabling compacts and flushes for region at 1675922592030Disabling writes for close at 1675922592030Writing region close event to WAL at 1675922592030Closed at 1675922592030 2023-02-09 06:03:12,031 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:12,031 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:12,031 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for dd03b135d141ff9e500396ed4cb9966d: Waiting for close lock at 1675922592030Disabling compacts and flushes for region at 1675922592030Disabling writes for close at 1675922592031 (+1 ms)Writing region close event to WAL at 1675922592031Closed at 1675922592031 2023-02-09 06:03:12,032 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2f32e10b7da81f7bf0cf85083961a6d5, disabling compactions & flushes 2023-02-09 06:03:12,032 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:12,032 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:12,032 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. after waiting 0 ms 2023-02-09 06:03:12,032 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:12,032 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:12,032 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2f32e10b7da81f7bf0cf85083961a6d5: Waiting for close lock at 1675922592032Disabling compacts and flushes for region at 1675922592032Disabling writes for close at 1675922592032Writing region close event to WAL at 1675922592032Closed at 1675922592032 2023-02-09 06:03:12,034 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 809be0c88168436aa5ab7a494653d528 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,034 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d65320a9fa7f4f619ea25e590f6d9e24 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,036 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing ec55c3edfc49ef841c2000d11245d19f, disabling compactions & flushes 2023-02-09 06:03:12,037 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:12,037 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:12,037 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. after waiting 0 ms 2023-02-09 06:03:12,037 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:12,037 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:12,037 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for ec55c3edfc49ef841c2000d11245d19f: Waiting for close lock at 1675922592036Disabling compacts and flushes for region at 1675922592036Disabling writes for close at 1675922592037 (+1 ms)Writing region close event to WAL at 1675922592037Closed at 1675922592037 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing d10b4f9dbd22ffe39dfd0ff87c38b6fa, disabling compactions & flushes 2023-02-09 06:03:12,040 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. after waiting 0 ms 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,040 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Waiting for close lock at 1675922592040Disabling compacts and flushes for region at 1675922592040Disabling writes for close at 1675922592040Writing region close event to WAL at 1675922592040Closed at 1675922592040 2023-02-09 06:03:12,040 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,040 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e211f2f863843628a4acccbd344b444 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,042 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,043 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 08a04ea3aa886ab428bf1248b056eb38, disabling compactions & flushes 2023-02-09 06:03:12,043 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,043 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,043 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. after waiting 0 ms 2023-02-09 06:03:12,043 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4bd9522ffc64f9db678b9303e45d930 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,043 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,043 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,043 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 08a04ea3aa886ab428bf1248b056eb38: Waiting for close lock at 1675922592043Disabling compacts and flushes for region at 1675922592043Disabling writes for close at 1675922592043Writing region close event to WAL at 1675922592043Closed at 1675922592043 2023-02-09 06:03:12,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 31ec182f145fee9b2fa8d74e1945e35e, disabling compactions & flushes 2023-02-09 06:03:12,045 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. after waiting 0 ms 2023-02-09 06:03:12,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,045 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 31ec182f145fee9b2fa8d74e1945e35e: Waiting for close lock at 1675922592045Disabling compacts and flushes for region at 1675922592045Disabling writes for close at 1675922592045Writing region close event to WAL at 1675922592045Closed at 1675922592045 2023-02-09 06:03:12,422 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,422 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a083a9c1cba48d2a806d305720a70c5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,425 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2a064947b7c44f1a1f8cfb6a35d647c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 06:03:12,427 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 6bce83b18f225424b9461a90fe0a8f68, disabling compactions & flushes 2023-02-09 06:03:12,427 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,427 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,427 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. after waiting 0 ms 2023-02-09 06:03:12,427 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,427 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,427 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 6bce83b18f225424b9461a90fe0a8f68: Waiting for close lock at 1675922592427Disabling compacts and flushes for region at 1675922592427Disabling writes for close at 1675922592427Writing region close event to WAL at 1675922592427Closed at 1675922592427 2023-02-09 06:03:12,428 INFO [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675922589126 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:12,428 DEBUG [Listener at localhost/34951] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:12,428 DEBUG [Listener at localhost/34951] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d 2023-02-09 06:03:12,428 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:12,429 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:12,429 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 06:03:12,430 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------08a04ea3aa886ab428bf1248b056eb38/ 2023-02-09 06:03:12,430 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,431 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------1ec122195731eb943af0673fb30f7b2b/ 2023-02-09 06:03:12,431 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,431 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,431 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec122195731eb943af0673fb30f7b2b-69535fb5860f45d391f5f24885be123f 2023-02-09 06:03:12,432 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,432 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec122195731eb943af0673fb30f7b2b-340ef70fb6d64e9dbd82253066612e09 2023-02-09 06:03:12,432 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------2f32e10b7da81f7bf0cf85083961a6d5/ 2023-02-09 06:03:12,433 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,433 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,433 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=2f32e10b7da81f7bf0cf85083961a6d5-e22e04a50f6e4a45aef8d5630ebcf4ee 2023-02-09 06:03:12,433 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,434 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=2f32e10b7da81f7bf0cf85083961a6d5-f94801481721468fbe3c12f8090c9270 2023-02-09 06:03:12,434 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------31ec182f145fee9b2fa8d74e1945e35e/ 2023-02-09 06:03:12,434 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,434 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,435 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=31ec182f145fee9b2fa8d74e1945e35e-2e211f2f863843628a4acccbd344b444 2023-02-09 06:03:12,435 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,435 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=31ec182f145fee9b2fa8d74e1945e35e-c4bd9522ffc64f9db678b9303e45d930 2023-02-09 06:03:12,435 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------3f2ddb856158359060e2511bb40ce530/ 2023-02-09 06:03:12,436 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,436 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------6bce83b18f225424b9461a90fe0a8f68/ 2023-02-09 06:03:12,436 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,436 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,437 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=6bce83b18f225424b9461a90fe0a8f68-3a083a9c1cba48d2a806d305720a70c5 2023-02-09 06:03:12,437 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,437 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=6bce83b18f225424b9461a90fe0a8f68-e2a064947b7c44f1a1f8cfb6a35d647c 2023-02-09 06:03:12,437 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------c03e57d2c1d15d47053374a61af9790a/ 2023-02-09 06:03:12,438 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,438 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,439 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=c03e57d2c1d15d47053374a61af9790a-c78eb42246ba4f97b9267d096989336c 2023-02-09 06:03:12,439 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,439 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=c03e57d2c1d15d47053374a61af9790a-8901a08d14be44e8b081e9759fe847cf 2023-02-09 06:03:12,439 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------d10b4f9dbd22ffe39dfd0ff87c38b6fa/ 2023-02-09 06:03:12,440 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,440 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,440 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=d10b4f9dbd22ffe39dfd0ff87c38b6fa-40b0ced009124de295b7e5ef3a9dc800 2023-02-09 06:03:12,440 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,441 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=d10b4f9dbd22ffe39dfd0ff87c38b6fa-809be0c88168436aa5ab7a494653d528 2023-02-09 06:03:12,441 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------dd03b135d141ff9e500396ed4cb9966d/ 2023-02-09 06:03:12,441 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,441 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,442 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=dd03b135d141ff9e500396ed4cb9966d-bcfa1a0231b746fbb3e607e1879c80f2 2023-02-09 06:03:12,442 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,442 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=dd03b135d141ff9e500396ed4cb9966d-c80e570b986a44918187d4a27ed12ee8 2023-02-09 06:03:12,442 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |----------ec55c3edfc49ef841c2000d11245d19f/ 2023-02-09 06:03:12,443 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:12,443 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:12,444 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=ec55c3edfc49ef841c2000d11245d19f-984b9ee4d76e45799b30745df1326c56 2023-02-09 06:03:12,444 DEBUG [Listener at localhost/34951] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:12,444 DEBUG [Listener at localhost/34951] util.CommonFSUtils(702): |----------------testWithMapReduce=ec55c3edfc49ef841c2000d11245d19f-d65320a9fa7f4f619ea25e590f6d9e24 2023-02-09 06:03:12,445 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,445 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,445 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,446 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,446 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,446 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,446 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,512 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop-9029270236566546063.jar 2023-02-09 06:03:12,513 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,513 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,514 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,514 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,514 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,515 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,515 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 06:03:12,515 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 06:03:12,516 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 06:03:12,516 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 06:03:12,516 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 06:03:12,517 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 06:03:12,518 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 06:03:12,518 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 06:03:12,519 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 06:03:12,519 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 06:03:12,520 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:12,521 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:12,521 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:12,522 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:12,522 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:12,590 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop-4626980498618144755.jar 2023-02-09 06:03:12,591 DEBUG [Listener at localhost/34951] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:12,596 WARN [Listener at localhost/34951] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 06:03:12,626 INFO [Listener at localhost/34951] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 06:03:12,721 WARN [Listener at localhost/34951] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/mapreduce.cluster.local.dir/1675922592688/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 06:03:12,721 WARN [Listener at localhost/34951] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/mapreduce.cluster.local.dir/1675922592688/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 06:03:12,756 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,756 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,757 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,759 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:12,761 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f1 2023-02-09 06:03:12,762 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08a04ea3aa886ab428bf1248b056eb38 columnFamilyName f1 2023-02-09 06:03:12,762 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(310): Store=08a04ea3aa886ab428bf1248b056eb38/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,762 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08a04ea3aa886ab428bf1248b056eb38 2023-02-09 06:03:12,764 DEBUG [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/08a04ea3aa886ab428bf1248b056eb38/f2 2023-02-09 06:03:12,764 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08a04ea3aa886ab428bf1248b056eb38 columnFamilyName f2 2023-02-09 06:03:12,765 INFO [StoreOpener-08a04ea3aa886ab428bf1248b056eb38-1] regionserver.HStore(310): Store=08a04ea3aa886ab428bf1248b056eb38/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,765 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:12,765 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08a04ea3aa886ab428bf1248b056eb38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65106916, jitterRate=-0.029831349849700928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:12,765 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08a04ea3aa886ab428bf1248b056eb38: Writing region info on filesystem at 1675922592757Initializing all the Stores at 1675922592759 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592759Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592759Region opened successfully at 1675922592765 (+6 ms) 2023-02-09 06:03:12,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08a04ea3aa886ab428bf1248b056eb38, disabling compactions & flushes 2023-02-09 06:03:12,782 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. after waiting 0 ms 2023-02-09 06:03:12,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,783 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675922587731.08a04ea3aa886ab428bf1248b056eb38. 2023-02-09 06:03:12,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08a04ea3aa886ab428bf1248b056eb38: Waiting for close lock at 1675922592782Disabling compacts and flushes for region at 1675922592782Disabling writes for close at 1675922592782Writing region close event to WAL at 1675922592783 (+1 ms)Closed at 1675922592783 2023-02-09 06:03:12,786 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,786 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,789 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,791 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:12,792 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f1 2023-02-09 06:03:12,792 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f2ddb856158359060e2511bb40ce530 columnFamilyName f1 2023-02-09 06:03:12,793 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(310): Store=3f2ddb856158359060e2511bb40ce530/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,793 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f2ddb856158359060e2511bb40ce530 2023-02-09 06:03:12,794 DEBUG [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/3f2ddb856158359060e2511bb40ce530/f2 2023-02-09 06:03:12,794 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f2ddb856158359060e2511bb40ce530 columnFamilyName f2 2023-02-09 06:03:12,795 INFO [StoreOpener-3f2ddb856158359060e2511bb40ce530-1] regionserver.HStore(310): Store=3f2ddb856158359060e2511bb40ce530/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:12,795 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3f2ddb856158359060e2511bb40ce530; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67147997, jitterRate=5.831271409988403E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:12,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3f2ddb856158359060e2511bb40ce530: Writing region info on filesystem at 1675922592789Initializing all the Stores at 1675922592790 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592790Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592790Region opened successfully at 1675922592795 (+5 ms) 2023-02-09 06:03:12,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3f2ddb856158359060e2511bb40ce530, disabling compactions & flushes 2023-02-09 06:03:12,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. after waiting 0 ms 2023-02-09 06:03:12,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,813 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922587731.3f2ddb856158359060e2511bb40ce530. 2023-02-09 06:03:12,813 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3f2ddb856158359060e2511bb40ce530: Waiting for close lock at 1675922592812Disabling compacts and flushes for region at 1675922592812Disabling writes for close at 1675922592812Writing region close event to WAL at 1675922592813 (+1 ms)Closed at 1675922592813 2023-02-09 06:03:12,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,816 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,817 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,819 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:12,820 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1 2023-02-09 06:03:12,820 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bce83b18f225424b9461a90fe0a8f68 columnFamilyName f1 2023-02-09 06:03:12,825 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f1/testWithMapReduce=6bce83b18f225424b9461a90fe0a8f68-3a083a9c1cba48d2a806d305720a70c5 2023-02-09 06:03:12,825 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(310): Store=6bce83b18f225424b9461a90fe0a8f68/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,825 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6bce83b18f225424b9461a90fe0a8f68 2023-02-09 06:03:12,826 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2 2023-02-09 06:03:12,827 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bce83b18f225424b9461a90fe0a8f68 columnFamilyName f2 2023-02-09 06:03:12,832 DEBUG [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/6bce83b18f225424b9461a90fe0a8f68/f2/testWithMapReduce=6bce83b18f225424b9461a90fe0a8f68-e2a064947b7c44f1a1f8cfb6a35d647c 2023-02-09 06:03:12,832 INFO [StoreOpener-6bce83b18f225424b9461a90fe0a8f68-1] regionserver.HStore(310): Store=6bce83b18f225424b9461a90fe0a8f68/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,832 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:12,832 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6bce83b18f225424b9461a90fe0a8f68; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59947647, jitterRate=-0.10671044886112213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:12,832 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6bce83b18f225424b9461a90fe0a8f68: Writing region info on filesystem at 1675922592817Initializing all the Stores at 1675922592818 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592818Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592818Region opened successfully at 1675922592832 (+14 ms) 2023-02-09 06:03:12,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6bce83b18f225424b9461a90fe0a8f68, disabling compactions & flushes 2023-02-09 06:03:12,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. after waiting 0 ms 2023-02-09 06:03:12,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675922587731.6bce83b18f225424b9461a90fe0a8f68. 2023-02-09 06:03:12,871 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6bce83b18f225424b9461a90fe0a8f68: Waiting for close lock at 1675922592869Disabling compacts and flushes for region at 1675922592869Disabling writes for close at 1675922592870 (+1 ms)Writing region close event to WAL at 1675922592870Closed at 1675922592870 2023-02-09 06:03:12,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,874 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,876 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,878 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:12,879 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1 2023-02-09 06:03:12,879 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10b4f9dbd22ffe39dfd0ff87c38b6fa columnFamilyName f1 2023-02-09 06:03:12,884 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1/testWithMapReduce=d10b4f9dbd22ffe39dfd0ff87c38b6fa-40b0ced009124de295b7e5ef3a9dc800 2023-02-09 06:03:12,884 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(310): Store=d10b4f9dbd22ffe39dfd0ff87c38b6fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,884 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d10b4f9dbd22ffe39dfd0ff87c38b6fa 2023-02-09 06:03:12,885 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2 2023-02-09 06:03:12,885 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10b4f9dbd22ffe39dfd0ff87c38b6fa columnFamilyName f2 2023-02-09 06:03:12,889 DEBUG [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2/testWithMapReduce=d10b4f9dbd22ffe39dfd0ff87c38b6fa-809be0c88168436aa5ab7a494653d528 2023-02-09 06:03:12,890 INFO [StoreOpener-d10b4f9dbd22ffe39dfd0ff87c38b6fa-1] regionserver.HStore(310): Store=d10b4f9dbd22ffe39dfd0ff87c38b6fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:12,890 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d10b4f9dbd22ffe39dfd0ff87c38b6fa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62187955, jitterRate=-0.07332725822925568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:12,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Writing region info on filesystem at 1675922592876Initializing all the Stores at 1675922592877 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592877Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592877Region opened successfully at 1675922592890 (+13 ms) 2023-02-09 06:03:12,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d10b4f9dbd22ffe39dfd0ff87c38b6fa, disabling compactions & flushes 2023-02-09 06:03:12,933 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. after waiting 0 ms 2023-02-09 06:03:12,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,934 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675922587731.d10b4f9dbd22ffe39dfd0ff87c38b6fa. 2023-02-09 06:03:12,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d10b4f9dbd22ffe39dfd0ff87c38b6fa: Waiting for close lock at 1675922592933Disabling compacts and flushes for region at 1675922592933Disabling writes for close at 1675922592933Writing region close event to WAL at 1675922592934 (+1 ms)Closed at 1675922592934 2023-02-09 06:03:12,938 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,938 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,940 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,943 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:12,944 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1 2023-02-09 06:03:12,944 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ec182f145fee9b2fa8d74e1945e35e columnFamilyName f1 2023-02-09 06:03:12,949 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f1/testWithMapReduce=31ec182f145fee9b2fa8d74e1945e35e-2e211f2f863843628a4acccbd344b444 2023-02-09 06:03:12,950 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(310): Store=31ec182f145fee9b2fa8d74e1945e35e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,950 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31ec182f145fee9b2fa8d74e1945e35e 2023-02-09 06:03:12,951 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2 2023-02-09 06:03:12,951 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ec182f145fee9b2fa8d74e1945e35e columnFamilyName f2 2023-02-09 06:03:12,956 DEBUG [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/31ec182f145fee9b2fa8d74e1945e35e/f2/testWithMapReduce=31ec182f145fee9b2fa8d74e1945e35e-c4bd9522ffc64f9db678b9303e45d930 2023-02-09 06:03:12,957 INFO [StoreOpener-31ec182f145fee9b2fa8d74e1945e35e-1] regionserver.HStore(310): Store=31ec182f145fee9b2fa8d74e1945e35e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:12,957 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:12,957 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 31ec182f145fee9b2fa8d74e1945e35e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71540997, jitterRate=0.0660439282655716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:12,957 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 31ec182f145fee9b2fa8d74e1945e35e: Writing region info on filesystem at 1675922592941Initializing all the Stores at 1675922592942 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592942Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592942Region opened successfully at 1675922592957 (+15 ms) 2023-02-09 06:03:12,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 31ec182f145fee9b2fa8d74e1945e35e, disabling compactions & flushes 2023-02-09 06:03:12,987 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. after waiting 0 ms 2023-02-09 06:03:12,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,988 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675922587731.31ec182f145fee9b2fa8d74e1945e35e. 2023-02-09 06:03:12,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 31ec182f145fee9b2fa8d74e1945e35e: Waiting for close lock at 1675922592987Disabling compacts and flushes for region at 1675922592987Disabling writes for close at 1675922592987Writing region close event to WAL at 1675922592988 (+1 ms)Closed at 1675922592988 2023-02-09 06:03:12,991 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:12,992 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:12,994 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:12,996 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:12,997 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1 2023-02-09 06:03:12,998 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f32e10b7da81f7bf0cf85083961a6d5 columnFamilyName f1 2023-02-09 06:03:13,003 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f1/testWithMapReduce=2f32e10b7da81f7bf0cf85083961a6d5-e22e04a50f6e4a45aef8d5630ebcf4ee 2023-02-09 06:03:13,004 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(310): Store=2f32e10b7da81f7bf0cf85083961a6d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,004 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2f32e10b7da81f7bf0cf85083961a6d5 2023-02-09 06:03:13,005 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2 2023-02-09 06:03:13,005 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f32e10b7da81f7bf0cf85083961a6d5 columnFamilyName f2 2023-02-09 06:03:13,010 DEBUG [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/2f32e10b7da81f7bf0cf85083961a6d5/f2/testWithMapReduce=2f32e10b7da81f7bf0cf85083961a6d5-f94801481721468fbe3c12f8090c9270 2023-02-09 06:03:13,010 INFO [StoreOpener-2f32e10b7da81f7bf0cf85083961a6d5-1] regionserver.HStore(310): Store=2f32e10b7da81f7bf0cf85083961a6d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:13,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2f32e10b7da81f7bf0cf85083961a6d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65198178, jitterRate=-0.028471440076828003}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:13,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2f32e10b7da81f7bf0cf85083961a6d5: Writing region info on filesystem at 1675922592994Initializing all the Stores at 1675922592995 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592995Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922592995Region opened successfully at 1675922593011 (+16 ms) 2023-02-09 06:03:13,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2f32e10b7da81f7bf0cf85083961a6d5, disabling compactions & flushes 2023-02-09 06:03:13,045 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:13,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:13,046 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. after waiting 0 ms 2023-02-09 06:03:13,046 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:13,046 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675922587731.2f32e10b7da81f7bf0cf85083961a6d5. 2023-02-09 06:03:13,047 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2f32e10b7da81f7bf0cf85083961a6d5: Waiting for close lock at 1675922593045Disabling compacts and flushes for region at 1675922593045Disabling writes for close at 1675922593046 (+1 ms)Writing region close event to WAL at 1675922593046Closed at 1675922593046 2023-02-09 06:03:13,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:13,050 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:13,051 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:13,055 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:13,056 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1 2023-02-09 06:03:13,057 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec122195731eb943af0673fb30f7b2b columnFamilyName f1 2023-02-09 06:03:13,062 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f1/testWithMapReduce=1ec122195731eb943af0673fb30f7b2b-69535fb5860f45d391f5f24885be123f 2023-02-09 06:03:13,062 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(310): Store=1ec122195731eb943af0673fb30f7b2b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,062 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec122195731eb943af0673fb30f7b2b 2023-02-09 06:03:13,063 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2 2023-02-09 06:03:13,064 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec122195731eb943af0673fb30f7b2b columnFamilyName f2 2023-02-09 06:03:13,068 DEBUG [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/1ec122195731eb943af0673fb30f7b2b/f2/testWithMapReduce=1ec122195731eb943af0673fb30f7b2b-340ef70fb6d64e9dbd82253066612e09 2023-02-09 06:03:13,068 INFO [StoreOpener-1ec122195731eb943af0673fb30f7b2b-1] regionserver.HStore(310): Store=1ec122195731eb943af0673fb30f7b2b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:13,069 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1ec122195731eb943af0673fb30f7b2b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68294215, jitterRate=0.017663106322288513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:13,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1ec122195731eb943af0673fb30f7b2b: Writing region info on filesystem at 1675922593051Initializing all the Stores at 1675922593052 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593052Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593055 (+3 ms)Region opened successfully at 1675922593069 (+14 ms) 2023-02-09 06:03:13,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1ec122195731eb943af0673fb30f7b2b, disabling compactions & flushes 2023-02-09 06:03:13,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:13,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:13,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. after waiting 0 ms 2023-02-09 06:03:13,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:13,099 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675922587731.1ec122195731eb943af0673fb30f7b2b. 2023-02-09 06:03:13,099 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1ec122195731eb943af0673fb30f7b2b: Waiting for close lock at 1675922593097Disabling compacts and flushes for region at 1675922593097Disabling writes for close at 1675922593098 (+1 ms)Writing region close event to WAL at 1675922593099 (+1 ms)Closed at 1675922593099 2023-02-09 06:03:13,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:13,102 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:13,104 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:13,105 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:13,106 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1 2023-02-09 06:03:13,107 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03e57d2c1d15d47053374a61af9790a columnFamilyName f1 2023-02-09 06:03:13,112 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f1/testWithMapReduce=c03e57d2c1d15d47053374a61af9790a-c78eb42246ba4f97b9267d096989336c 2023-02-09 06:03:13,112 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(310): Store=c03e57d2c1d15d47053374a61af9790a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,112 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c03e57d2c1d15d47053374a61af9790a 2023-02-09 06:03:13,113 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2 2023-02-09 06:03:13,113 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03e57d2c1d15d47053374a61af9790a columnFamilyName f2 2023-02-09 06:03:13,117 DEBUG [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/c03e57d2c1d15d47053374a61af9790a/f2/testWithMapReduce=c03e57d2c1d15d47053374a61af9790a-8901a08d14be44e8b081e9759fe847cf 2023-02-09 06:03:13,117 INFO [StoreOpener-c03e57d2c1d15d47053374a61af9790a-1] regionserver.HStore(310): Store=c03e57d2c1d15d47053374a61af9790a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,117 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:13,117 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c03e57d2c1d15d47053374a61af9790a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67507398, jitterRate=0.005938619375228882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:13,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c03e57d2c1d15d47053374a61af9790a: Writing region info on filesystem at 1675922593104Initializing all the Stores at 1675922593105 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593105Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593105Region opened successfully at 1675922593118 (+13 ms) 2023-02-09 06:03:13,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c03e57d2c1d15d47053374a61af9790a, disabling compactions & flushes 2023-02-09 06:03:13,145 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:13,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:13,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. after waiting 0 ms 2023-02-09 06:03:13,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:13,145 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675922587731.c03e57d2c1d15d47053374a61af9790a. 2023-02-09 06:03:13,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c03e57d2c1d15d47053374a61af9790a: Waiting for close lock at 1675922593144Disabling compacts and flushes for region at 1675922593144Disabling writes for close at 1675922593145 (+1 ms)Writing region close event to WAL at 1675922593145Closed at 1675922593145 2023-02-09 06:03:13,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:13,148 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:13,149 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:13,151 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:13,152 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1 2023-02-09 06:03:13,152 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec55c3edfc49ef841c2000d11245d19f columnFamilyName f1 2023-02-09 06:03:13,157 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f1/testWithMapReduce=ec55c3edfc49ef841c2000d11245d19f-984b9ee4d76e45799b30745df1326c56 2023-02-09 06:03:13,157 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(310): Store=ec55c3edfc49ef841c2000d11245d19f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,157 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec55c3edfc49ef841c2000d11245d19f 2023-02-09 06:03:13,158 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2 2023-02-09 06:03:13,158 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec55c3edfc49ef841c2000d11245d19f columnFamilyName f2 2023-02-09 06:03:13,162 DEBUG [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/ec55c3edfc49ef841c2000d11245d19f/f2/testWithMapReduce=ec55c3edfc49ef841c2000d11245d19f-d65320a9fa7f4f619ea25e590f6d9e24 2023-02-09 06:03:13,162 INFO [StoreOpener-ec55c3edfc49ef841c2000d11245d19f-1] regionserver.HStore(310): Store=ec55c3edfc49ef841c2000d11245d19f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:13,163 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ec55c3edfc49ef841c2000d11245d19f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60675162, jitterRate=-0.09586963057518005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:13,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ec55c3edfc49ef841c2000d11245d19f: Writing region info on filesystem at 1675922593149Initializing all the Stores at 1675922593150 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593150Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593150Region opened successfully at 1675922593163 (+13 ms) 2023-02-09 06:03:13,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ec55c3edfc49ef841c2000d11245d19f, disabling compactions & flushes 2023-02-09 06:03:13,198 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:13,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:13,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. after waiting 0 ms 2023-02-09 06:03:13,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:13,199 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675922587731.ec55c3edfc49ef841c2000d11245d19f. 2023-02-09 06:03:13,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ec55c3edfc49ef841c2000d11245d19f: Waiting for close lock at 1675922593198Disabling compacts and flushes for region at 1675922593198Disabling writes for close at 1675922593198Writing region close event to WAL at 1675922593199 (+1 ms)Closed at 1675922593199 2023-02-09 06:03:13,202 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:13,202 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:13,204 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:13,206 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:13,207 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1 2023-02-09 06:03:13,208 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd03b135d141ff9e500396ed4cb9966d columnFamilyName f1 2023-02-09 06:03:13,213 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f1/testWithMapReduce=dd03b135d141ff9e500396ed4cb9966d-bcfa1a0231b746fbb3e607e1879c80f2 2023-02-09 06:03:13,213 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(310): Store=dd03b135d141ff9e500396ed4cb9966d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,213 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd03b135d141ff9e500396ed4cb9966d 2023-02-09 06:03:13,214 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2 2023-02-09 06:03:13,214 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd03b135d141ff9e500396ed4cb9966d columnFamilyName f2 2023-02-09 06:03:13,219 DEBUG [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(539): loaded hdfs://localhost:41121/user/jenkins/test-data/10ac03d5-53cb-efec-ba16-423298382649/testWithMapReduceAndOfflineHBaseMultiRegion/57e00037-cfbe-4fe6-8b50-14429495139d/data/default/testWithMapReduce/dd03b135d141ff9e500396ed4cb9966d/f2/testWithMapReduce=dd03b135d141ff9e500396ed4cb9966d-c80e570b986a44918187d4a27ed12ee8 2023-02-09 06:03:13,219 INFO [StoreOpener-dd03b135d141ff9e500396ed4cb9966d-1] regionserver.HStore(310): Store=dd03b135d141ff9e500396ed4cb9966d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:13,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:13,220 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dd03b135d141ff9e500396ed4cb9966d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75372546, jitterRate=0.12313845753669739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:13,220 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dd03b135d141ff9e500396ed4cb9966d: Writing region info on filesystem at 1675922593204Initializing all the Stores at 1675922593205 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593205Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922593205Region opened successfully at 1675922593220 (+15 ms) 2023-02-09 06:03:13,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dd03b135d141ff9e500396ed4cb9966d, disabling compactions & flushes 2023-02-09 06:03:13,255 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:13,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:13,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. after waiting 0 ms 2023-02-09 06:03:13,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:13,256 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675922587731.dd03b135d141ff9e500396ed4cb9966d. 2023-02-09 06:03:13,256 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dd03b135d141ff9e500396ed4cb9966d: Waiting for close lock at 1675922593255Disabling compacts and flushes for region at 1675922593255Disabling writes for close at 1675922593255Writing region close event to WAL at 1675922593256 (+1 ms)Closed at 1675922593256 2023-02-09 06:03:13,756 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:13,757 WARN [Listener at localhost/34951] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:13,761 INFO [Listener at localhost/34951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:13,864 WARN [BP-152991000-172.31.14.131-1675922585469 heartbeating to localhost/127.0.0.1:41121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:13,865 WARN [BP-152991000-172.31.14.131-1675922585469 heartbeating to localhost/127.0.0.1:41121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-152991000-172.31.14.131-1675922585469 (Datanode Uuid cda5d7b4-f377-4472-bce8-3defa47cf549) service to localhost/127.0.0.1:41121 2023-02-09 06:03:13,865 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/dfs/data/data3/current/BP-152991000-172.31.14.131-1675922585469] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:13,866 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/dfs/data/data4/current/BP-152991000-172.31.14.131-1675922585469] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:13,869 WARN [Listener at localhost/34951] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:13,878 INFO [Listener at localhost/34951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:13,980 WARN [BP-152991000-172.31.14.131-1675922585469 heartbeating to localhost/127.0.0.1:41121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:13,980 WARN [BP-152991000-172.31.14.131-1675922585469 heartbeating to localhost/127.0.0.1:41121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-152991000-172.31.14.131-1675922585469 (Datanode Uuid 3e9aebe2-8dde-47ca-9190-f1a69272ca9e) service to localhost/127.0.0.1:41121 2023-02-09 06:03:13,981 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/dfs/data/data1/current/BP-152991000-172.31.14.131-1675922585469] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:13,982 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/cluster_85a72a37-4ace-c8a8-afbd-9b4f4146fe62/dfs/data/data2/current/BP-152991000-172.31.14.131-1675922585469] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:13,991 INFO [Listener at localhost/34951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:14,112 INFO [Listener at localhost/34951] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:14,154 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:14,166 INFO [Listener at localhost/34951] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=159 (was 104) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34951 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41121 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33743,1675922586252)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:41121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:41121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41121 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41121 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41121 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=535 (was 529) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3713 (was 3914) 2023-02-09 06:03:14,176 INFO [Listener at localhost/34951] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=159, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=166, AvailableMemoryMB=3713 2023-02-09 06:03:14,186 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.log.dir so I do NOT create it in target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c 2023-02-09 06:03:14,186 WARN [Listener at localhost/34951] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:14,186 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.tmp.dir so I do NOT create it in target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c 2023-02-09 06:03:14,186 WARN [Listener at localhost/34951] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/040f44a1-f4cb-063d-ee6c-487062af17be/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:14,186 DEBUG [Listener at localhost/34951] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214, deleteOnExit=true 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/test.cache.data in system properties and HBase conf 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:14,187 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:14,187 DEBUG [Listener at localhost/34951] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:14,188 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:14,189 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:14,189 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:14,189 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:14,189 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:14,189 INFO [Listener at localhost/34951] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:14,193 WARN [Listener at localhost/34951] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:14,193 WARN [Listener at localhost/34951] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:14,231 WARN [Listener at localhost/34951] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:14,233 INFO [Listener at localhost/34951] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:14,238 INFO [Listener at localhost/34951] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/java.io.tmpdir/Jetty_localhost_44131_hdfs____.g9lmdj/webapp 2023-02-09 06:03:14,329 INFO [Listener at localhost/34951] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44131 2023-02-09 06:03:14,334 WARN [Listener at localhost/34951] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:14,334 WARN [Listener at localhost/34951] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:14,374 WARN [Listener at localhost/44673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:14,386 WARN [Listener at localhost/44673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:14,388 WARN [Listener at localhost/44673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:14,389 INFO [Listener at localhost/44673] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:14,395 INFO [Listener at localhost/44673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/java.io.tmpdir/Jetty_localhost_33393_datanode____lg6pp0/webapp 2023-02-09 06:03:14,488 INFO [Listener at localhost/44673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33393 2023-02-09 06:03:14,538 WARN [Listener at localhost/45815] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:14,554 WARN [Listener at localhost/45815] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:14,557 WARN [Listener at localhost/45815] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:14,558 INFO [Listener at localhost/45815] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:14,563 INFO [Listener at localhost/45815] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/java.io.tmpdir/Jetty_localhost_42751_datanode____.hxvqv8/webapp 2023-02-09 06:03:14,638 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x777678212cf1022c: Processing first storage report for DS-8673df65-bfd1-4899-8382-738248cc404e from datanode 1bfde75b-406e-4cda-aede-081c354291ad 2023-02-09 06:03:14,638 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x777678212cf1022c: from storage DS-8673df65-bfd1-4899-8382-738248cc404e node DatanodeRegistration(127.0.0.1:37693, datanodeUuid=1bfde75b-406e-4cda-aede-081c354291ad, infoPort=34135, infoSecurePort=0, ipcPort=45815, storageInfo=lv=-57;cid=testClusterID;nsid=845531943;c=1675922594196), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:14,638 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x777678212cf1022c: Processing first storage report for DS-0f994536-8fc2-4113-83b7-7a6258a473c0 from datanode 1bfde75b-406e-4cda-aede-081c354291ad 2023-02-09 06:03:14,638 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x777678212cf1022c: from storage DS-0f994536-8fc2-4113-83b7-7a6258a473c0 node DatanodeRegistration(127.0.0.1:37693, datanodeUuid=1bfde75b-406e-4cda-aede-081c354291ad, infoPort=34135, infoSecurePort=0, ipcPort=45815, storageInfo=lv=-57;cid=testClusterID;nsid=845531943;c=1675922594196), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:14,666 INFO [Listener at localhost/45815] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42751 2023-02-09 06:03:14,684 WARN [Listener at localhost/44245] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:14,771 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48bade597dcfdd92: Processing first storage report for DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e from datanode b08c219d-2349-49ce-bb1f-afdbb1cff26c 2023-02-09 06:03:14,771 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48bade597dcfdd92: from storage DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e node DatanodeRegistration(127.0.0.1:39881, datanodeUuid=b08c219d-2349-49ce-bb1f-afdbb1cff26c, infoPort=39731, infoSecurePort=0, ipcPort=44245, storageInfo=lv=-57;cid=testClusterID;nsid=845531943;c=1675922594196), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:14,771 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48bade597dcfdd92: Processing first storage report for DS-e9eabd04-e998-4c22-ade2-8b015f1b2ad9 from datanode b08c219d-2349-49ce-bb1f-afdbb1cff26c 2023-02-09 06:03:14,771 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48bade597dcfdd92: from storage DS-e9eabd04-e998-4c22-ade2-8b015f1b2ad9 node DatanodeRegistration(127.0.0.1:39881, datanodeUuid=b08c219d-2349-49ce-bb1f-afdbb1cff26c, infoPort=39731, infoSecurePort=0, ipcPort=44245, storageInfo=lv=-57;cid=testClusterID;nsid=845531943;c=1675922594196), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:14,795 DEBUG [Listener at localhost/44245] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c 2023-02-09 06:03:14,797 INFO [Listener at localhost/44245] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/zookeeper_0, clientPort=64032, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:14,798 INFO [Listener at localhost/44245] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64032 2023-02-09 06:03:14,798 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,799 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,811 INFO [Listener at localhost/44245] util.FSUtils(479): Created version file at hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f with version=8 2023-02-09 06:03:14,811 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,812 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,813 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44673/user/jenkins/test-data/289a1c17-322e-eccf-8b09-e2beab5957ee/hbase-staging 2023-02-09 06:03:14,814 INFO [Listener at localhost/44245] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:14,815 INFO [Listener at localhost/44245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:14,816 INFO [Listener at localhost/44245] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38867 2023-02-09 06:03:14,817 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,817 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,818 INFO [Listener at localhost/44245] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38867 connecting to ZooKeeper ensemble=127.0.0.1:64032 2023-02-09 06:03:14,824 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:388670x0, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:14,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38867-0x10037ad45b10000 connected 2023-02-09 06:03:14,846 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:14,846 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:14,847 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:14,848 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38867 2023-02-09 06:03:14,850 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38867 2023-02-09 06:03:14,850 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38867 2023-02-09 06:03:14,851 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38867 2023-02-09 06:03:14,852 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38867 2023-02-09 06:03:14,852 INFO [Listener at localhost/44245] master.HMaster(439): hbase.rootdir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f, hbase.cluster.distributed=false 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:14,868 INFO [Listener at localhost/44245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:14,871 INFO [Listener at localhost/44245] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41927 2023-02-09 06:03:14,872 INFO [Listener at localhost/44245] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:14,873 DEBUG [Listener at localhost/44245] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:14,874 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,875 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,876 INFO [Listener at localhost/44245] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41927 connecting to ZooKeeper ensemble=127.0.0.1:64032 2023-02-09 06:03:14,880 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:419270x0, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:14,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41927-0x10037ad45b10001 connected 2023-02-09 06:03:14,881 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:14,882 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:14,882 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:14,883 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41927 2023-02-09 06:03:14,883 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41927 2023-02-09 06:03:14,888 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41927 2023-02-09 06:03:14,888 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41927 2023-02-09 06:03:14,889 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41927 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:14,900 INFO [Listener at localhost/44245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:14,903 INFO [Listener at localhost/44245] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39153 2023-02-09 06:03:14,903 INFO [Listener at localhost/44245] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:14,908 DEBUG [Listener at localhost/44245] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:14,908 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,909 INFO [Listener at localhost/44245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,910 INFO [Listener at localhost/44245] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39153 connecting to ZooKeeper ensemble=127.0.0.1:64032 2023-02-09 06:03:14,914 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:391530x0, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:14,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39153-0x10037ad45b10002 connected 2023-02-09 06:03:14,917 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:14,917 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:14,918 DEBUG [Listener at localhost/44245] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:14,919 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39153 2023-02-09 06:03:14,919 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39153 2023-02-09 06:03:14,920 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39153 2023-02-09 06:03:14,922 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39153 2023-02-09 06:03:14,922 DEBUG [Listener at localhost/44245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39153 2023-02-09 06:03:14,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:14,924 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:14,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:14,926 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:14,926 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:14,926 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:14,926 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:14,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:14,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38867,1675922594814 from backup master directory 2023-02-09 06:03:14,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:14,929 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:14,929 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:14,929 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:14,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:14,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/hbase.id with ID: 7153e610-282b-40a9-85ec-b0a46300e100 2023-02-09 06:03:14,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:14,958 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:14,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3d4ff741 to 127.0.0.1:64032 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:14,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@112ea6ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:14,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:14,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:14,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:14,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store-tmp 2023-02-09 06:03:14,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:14,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:14,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922594989Disabling compacts and flushes for region at 1675922594989Disabling writes for close at 1675922594989Writing region close event to WAL at 1675922594989Closed at 1675922594989 2023-02-09 06:03:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/WALs/jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:14,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38867%2C1675922594814, suffix=, logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/WALs/jenkins-hbase4.apache.org,38867,1675922594814, archiveDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:15,011 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK] 2023-02-09 06:03:15,012 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK] 2023-02-09 06:03:15,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/WALs/jenkins-hbase4.apache.org,38867,1675922594814/jenkins-hbase4.apache.org%2C38867%2C1675922594814.1675922594992 2023-02-09 06:03:15,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK], DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK]] 2023-02-09 06:03:15,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:15,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,015 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,017 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:15,017 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:15,017 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:15,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:15,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74794656, jitterRate=0.11452722549438477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922595014Initializing all the Stores at 1675922595015 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922595015Cleaning up temporary data from old regions at 1675922595019 (+4 ms)Cleaning up detritus from prior splits at 1675922595019Region opened successfully at 1675922595023 (+4 ms) 2023-02-09 06:03:15,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:15,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:15,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:15,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:15,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:15,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:15,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:15,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:15,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:15,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:15,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:15,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:15,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:15,039 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:15,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:15,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:15,041 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:15,041 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:15,041 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,041 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:15,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,38867,1675922594814, sessionid=0x10037ad45b10000, setting cluster-up flag (Was=false) 2023-02-09 06:03:15,047 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:15,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:15,055 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:15,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:15,060 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/.tmp 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:15,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922625063 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:15,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,064 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:15,064 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:15,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:15,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:15,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:15,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:15,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:15,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922595065,5,FailOnTimeoutGroup] 2023-02-09 06:03:15,066 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:15,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922595065,5,FailOnTimeoutGroup] 2023-02-09 06:03:15,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:15,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,076 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:15,077 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:15,077 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f 2023-02-09 06:03:15,084 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:15,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/info 2023-02-09 06:03:15,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:15,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:15,088 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:15,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:15,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:15,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/table 2023-02-09 06:03:15,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:15,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740 2023-02-09 06:03:15,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740 2023-02-09 06:03:15,093 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:15,094 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:15,095 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:15,096 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68901458, jitterRate=0.026711732149124146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:15,096 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922595085Initializing all the Stores at 1675922595085Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922595085Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922595085Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922595085Cleaning up temporary data from old regions at 1675922595092 (+7 ms)Cleaning up detritus from prior splits at 1675922595092Region opened successfully at 1675922595096 (+4 ms) 2023-02-09 06:03:15,096 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:15,096 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:15,096 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:15,096 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:15,096 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:15,100 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:15,100 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922595096Disabling compacts and flushes for region at 1675922595096Disabling writes for close at 1675922595096Writing region close event to WAL at 1675922595100 (+4 ms)Closed at 1675922595100 2023-02-09 06:03:15,101 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:15,101 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:15,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:15,103 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:15,104 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:15,124 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(952): ClusterId : 7153e610-282b-40a9-85ec-b0a46300e100 2023-02-09 06:03:15,124 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(952): ClusterId : 7153e610-282b-40a9-85ec-b0a46300e100 2023-02-09 06:03:15,124 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:15,125 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:15,127 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:15,127 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:15,127 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:15,127 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:15,130 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:15,131 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:15,131 DEBUG [RS:0;jenkins-hbase4:41927] zookeeper.ReadOnlyZKClient(139): Connect 0x12c72740 to 127.0.0.1:64032 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:15,132 DEBUG [RS:1;jenkins-hbase4:39153] zookeeper.ReadOnlyZKClient(139): Connect 0x1548537c to 127.0.0.1:64032 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:15,137 DEBUG [RS:0;jenkins-hbase4:41927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c00cb68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:15,137 DEBUG [RS:1;jenkins-hbase4:39153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b8fbfa5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:15,137 DEBUG [RS:0;jenkins-hbase4:41927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@183f4c30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:15,137 DEBUG [RS:1;jenkins-hbase4:39153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fb0380c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:15,145 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39153 2023-02-09 06:03:15,146 INFO [RS:1;jenkins-hbase4:39153] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:15,146 INFO [RS:1;jenkins-hbase4:39153] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:15,146 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:15,146 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38867,1675922594814 with isa=jenkins-hbase4.apache.org/172.31.14.131:39153, startcode=1675922594899 2023-02-09 06:03:15,146 DEBUG [RS:1;jenkins-hbase4:39153] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:15,148 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52395, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:15,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,150 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f 2023-02-09 06:03:15,150 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44673 2023-02-09 06:03:15,150 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:15,150 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41927 2023-02-09 06:03:15,150 INFO [RS:0;jenkins-hbase4:41927] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:15,150 INFO [RS:0;jenkins-hbase4:41927] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:15,150 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:15,151 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:15,151 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38867,1675922594814 with isa=jenkins-hbase4.apache.org/172.31.14.131:41927, startcode=1675922594867 2023-02-09 06:03:15,151 DEBUG [RS:0;jenkins-hbase4:41927] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:15,151 DEBUG [RS:1;jenkins-hbase4:39153] zookeeper.ZKUtil(162): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,152 WARN [RS:1;jenkins-hbase4:39153] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:15,152 INFO [RS:1;jenkins-hbase4:39153] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:15,152 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,153 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39153,1675922594899] 2023-02-09 06:03:15,155 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41551, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:15,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,156 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f 2023-02-09 06:03:15,156 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44673 2023-02-09 06:03:15,156 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:15,161 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:15,161 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:15,161 DEBUG [RS:1;jenkins-hbase4:39153] zookeeper.ZKUtil(162): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,161 DEBUG [RS:0;jenkins-hbase4:41927] zookeeper.ZKUtil(162): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,161 WARN [RS:0;jenkins-hbase4:41927] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:15,161 INFO [RS:0;jenkins-hbase4:41927] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:15,161 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41927,1675922594867] 2023-02-09 06:03:15,161 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,162 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:15,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,162 INFO [RS:1;jenkins-hbase4:39153] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:15,165 INFO [RS:1;jenkins-hbase4:39153] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:15,166 INFO [RS:1;jenkins-hbase4:39153] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:15,166 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,166 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:15,167 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,167 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:0;jenkins-hbase4:41927] zookeeper.ZKUtil(162): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:1;jenkins-hbase4:39153] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,168 DEBUG [RS:0;jenkins-hbase4:41927] zookeeper.ZKUtil(162): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,169 DEBUG [RS:0;jenkins-hbase4:41927] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:15,169 INFO [RS:0;jenkins-hbase4:41927] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:15,172 INFO [RS:0;jenkins-hbase4:41927] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:15,173 INFO [RS:0;jenkins-hbase4:41927] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:15,173 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,173 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,173 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,173 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,173 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:15,174 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,174 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:15,175 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,175 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,175 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,175 DEBUG [RS:0;jenkins-hbase4:41927] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:15,176 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,176 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,176 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,185 INFO [RS:1;jenkins-hbase4:39153] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:15,185 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39153,1675922594899-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,189 INFO [RS:0;jenkins-hbase4:41927] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:15,189 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41927,1675922594867-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,196 INFO [RS:1;jenkins-hbase4:39153] regionserver.Replication(203): jenkins-hbase4.apache.org,39153,1675922594899 started 2023-02-09 06:03:15,196 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39153,1675922594899, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39153, sessionid=0x10037ad45b10002 2023-02-09 06:03:15,196 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:15,196 DEBUG [RS:1;jenkins-hbase4:39153] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,196 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39153,1675922594899' 2023-02-09 06:03:15,196 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:15,196 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39153,1675922594899' 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:15,197 DEBUG [RS:1;jenkins-hbase4:39153] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:15,197 INFO [RS:1;jenkins-hbase4:39153] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:15,197 INFO [RS:1;jenkins-hbase4:39153] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:15,199 INFO [RS:0;jenkins-hbase4:41927] regionserver.Replication(203): jenkins-hbase4.apache.org,41927,1675922594867 started 2023-02-09 06:03:15,199 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41927,1675922594867, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41927, sessionid=0x10037ad45b10001 2023-02-09 06:03:15,199 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:15,199 DEBUG [RS:0;jenkins-hbase4:41927] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,199 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41927,1675922594867' 2023-02-09 06:03:15,199 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41927,1675922594867' 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:15,200 DEBUG [RS:0;jenkins-hbase4:41927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:15,201 DEBUG [RS:0;jenkins-hbase4:41927] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:15,201 INFO [RS:0;jenkins-hbase4:41927] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:15,201 INFO [RS:0;jenkins-hbase4:41927] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:15,255 DEBUG [jenkins-hbase4:38867] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:15,255 DEBUG [jenkins-hbase4:38867] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:15,256 DEBUG [jenkins-hbase4:38867] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:15,256 DEBUG [jenkins-hbase4:38867] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:15,256 DEBUG [jenkins-hbase4:38867] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:15,258 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39153,1675922594899, state=OPENING 2023-02-09 06:03:15,259 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:15,260 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39153,1675922594899}] 2023-02-09 06:03:15,260 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:15,415 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,415 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:15,416 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:15,421 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:15,421 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:15,422 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39153%2C1675922594899.meta, suffix=.meta, logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,39153,1675922594899, archiveDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs, maxLogs=32 2023-02-09 06:03:15,437 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK] 2023-02-09 06:03:15,437 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK] 2023-02-09 06:03:15,438 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,39153,1675922594899/jenkins-hbase4.apache.org%2C39153%2C1675922594899.meta.1675922595423.meta 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK], DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK]] 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:15,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:15,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:15,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:15,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/info 2023-02-09 06:03:15,442 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/info 2023-02-09 06:03:15,442 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:15,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:15,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:15,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:15,443 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:15,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:15,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/table 2023-02-09 06:03:15,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/table 2023-02-09 06:03:15,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:15,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740 2023-02-09 06:03:15,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740 2023-02-09 06:03:15,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:15,450 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:15,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72866943, jitterRate=0.08580206334590912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:15,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922595439Writing region info on filesystem at 1675922595439Initializing all the Stores at 1675922595440 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922595440Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922595440Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922595440Cleaning up temporary data from old regions at 1675922595448 (+8 ms)Cleaning up detritus from prior splits at 1675922595448Running coprocessor post-open hooks at 1675922595451 (+3 ms)Region opened successfully at 1675922595451 2023-02-09 06:03:15,452 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922595415 2023-02-09 06:03:15,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:15,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:15,456 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39153,1675922594899, state=OPEN 2023-02-09 06:03:15,457 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:15,458 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:15,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:15,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39153,1675922594899 in 198 msec 2023-02-09 06:03:15,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:15,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-09 06:03:15,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 400 msec 2023-02-09 06:03:15,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922594925, completionTime=-1 2023-02-09 06:03:15,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:15,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:15,466 DEBUG [hconnection-0x2373230a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:15,467 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:15,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:15,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922655468 2023-02-09 06:03:15,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922715468 2023-02-09 06:03:15,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38867,1675922594814-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38867,1675922594814-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38867,1675922594814-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38867, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:15,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:15,480 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:15,480 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:15,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:15,483 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,484 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738 empty. 2023-02-09 06:03:15,484 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:15,494 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:15,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3dd3a8ba16f6787739538c6e00a58738, NAME => 'hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3dd3a8ba16f6787739538c6e00a58738, disabling compactions & flushes 2023-02-09 06:03:15,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. after waiting 0 ms 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3dd3a8ba16f6787739538c6e00a58738: Waiting for close lock at 1675922595501Disabling compacts and flushes for region at 1675922595501Disabling writes for close at 1675922595501Writing region close event to WAL at 1675922595501Closed at 1675922595501 2023-02-09 06:03:15,503 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:15,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922595504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922595504"}]},"ts":"1675922595504"} 2023-02-09 06:03:15,506 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:15,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:15,507 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922595507"}]},"ts":"1675922595507"} 2023-02-09 06:03:15,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:15,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:15,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:15,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:15,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:15,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3dd3a8ba16f6787739538c6e00a58738, ASSIGN}] 2023-02-09 06:03:15,514 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3dd3a8ba16f6787739538c6e00a58738, ASSIGN 2023-02-09 06:03:15,515 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3dd3a8ba16f6787739538c6e00a58738, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39153,1675922594899; forceNewPlan=false, retain=false 2023-02-09 06:03:15,665 INFO [jenkins-hbase4:38867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:15,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3dd3a8ba16f6787739538c6e00a58738, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922595666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922595666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922595666"}]},"ts":"1675922595666"} 2023-02-09 06:03:15,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3dd3a8ba16f6787739538c6e00a58738, server=jenkins-hbase4.apache.org,39153,1675922594899}] 2023-02-09 06:03:15,824 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,825 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39153%2C1675922594899, suffix=, logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,39153,1675922594899, archiveDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs, maxLogs=32 2023-02-09 06:03:15,845 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK] 2023-02-09 06:03:15,845 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK] 2023-02-09 06:03:15,847 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,39153,1675922594899/jenkins-hbase4.apache.org%2C39153%2C1675922594899.1675922595826 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK], DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK]] 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3dd3a8ba16f6787739538c6e00a58738, NAME => 'hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,849 INFO [StoreOpener-3dd3a8ba16f6787739538c6e00a58738-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,850 DEBUG [StoreOpener-3dd3a8ba16f6787739538c6e00a58738-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/info 2023-02-09 06:03:15,850 DEBUG [StoreOpener-3dd3a8ba16f6787739538c6e00a58738-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/info 2023-02-09 06:03:15,850 INFO [StoreOpener-3dd3a8ba16f6787739538c6e00a58738-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dd3a8ba16f6787739538c6e00a58738 columnFamilyName info 2023-02-09 06:03:15,851 INFO [StoreOpener-3dd3a8ba16f6787739538c6e00a58738-1] regionserver.HStore(310): Store=3dd3a8ba16f6787739538c6e00a58738/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:15,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,854 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:15,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:15,856 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3dd3a8ba16f6787739538c6e00a58738; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67541688, jitterRate=0.006449580192565918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:15,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3dd3a8ba16f6787739538c6e00a58738: Running coprocessor pre-open hook at 1675922595848Writing region info on filesystem at 1675922595848Initializing all the Stores at 1675922595848Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922595848Cleaning up temporary data from old regions at 1675922595852 (+4 ms)Cleaning up detritus from prior splits at 1675922595852Running coprocessor post-open hooks at 1675922595856 (+4 ms)Region opened successfully at 1675922595856 2023-02-09 06:03:15,857 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738., pid=6, masterSystemTime=1675922595820 2023-02-09 06:03:15,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,858 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:15,859 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3dd3a8ba16f6787739538c6e00a58738, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:15,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922595859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922595859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922595859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922595859"}]},"ts":"1675922595859"} 2023-02-09 06:03:15,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:15,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3dd3a8ba16f6787739538c6e00a58738, server=jenkins-hbase4.apache.org,39153,1675922594899 in 192 msec 2023-02-09 06:03:15,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:15,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3dd3a8ba16f6787739538c6e00a58738, ASSIGN in 350 msec 2023-02-09 06:03:15,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:15,864 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922595864"}]},"ts":"1675922595864"} 2023-02-09 06:03:15,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:15,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:15,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 391 msec 2023-02-09 06:03:15,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:15,881 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:15,881 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:15,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:15,891 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:15,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 06:03:15,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:15,903 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:15,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 06:03:15,910 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:15,913 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:15,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.984sec 2023-02-09 06:03:15,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:15,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:15,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:15,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38867,1675922594814-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:15,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38867,1675922594814-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:15,925 DEBUG [Listener at localhost/44245] zookeeper.ReadOnlyZKClient(139): Connect 0x54c013c9 to 127.0.0.1:64032 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:15,929 DEBUG [Listener at localhost/44245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d1d89df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:15,930 DEBUG [hconnection-0x4ac18348-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:15,932 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:15,933 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:15,934 DEBUG [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:15,934 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:15,934 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:15,936 DEBUG [Listener at localhost/44245] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:15,937 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:15,938 INFO [Listener at localhost/44245] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:15,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:43428 deadline: 1675922655938, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:15,939 INFO [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 06:03:15,939 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:15,940 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:15,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:15,944 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:15,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-09 06:03:15,945 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:15,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:15,945 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:15,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:15,946 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:15,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 empty. 2023-02-09 06:03:15,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:15,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 06:03:15,956 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:15,957 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3685e622e5d3c685e417a389601a9d54, NAME => 'testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp 2023-02-09 06:03:15,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:15,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 3685e622e5d3c685e417a389601a9d54, disabling compactions & flushes 2023-02-09 06:03:15,963 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:15,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:15,964 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. after waiting 0 ms 2023-02-09 06:03:15,964 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:15,964 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:15,964 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 3685e622e5d3c685e417a389601a9d54: Waiting for close lock at 1675922595963Disabling compacts and flushes for region at 1675922595963Disabling writes for close at 1675922595964 (+1 ms)Writing region close event to WAL at 1675922595964Closed at 1675922595964 2023-02-09 06:03:15,966 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:15,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675922595966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922595966"}]},"ts":"1675922595966"} 2023-02-09 06:03:15,968 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:15,969 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:15,969 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922595969"}]},"ts":"1675922595969"} 2023-02-09 06:03:15,970 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-09 06:03:15,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:15,975 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:15,975 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:15,975 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:15,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, ASSIGN}] 2023-02-09 06:03:15,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, ASSIGN 2023-02-09 06:03:15,978 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41927,1675922594867; forceNewPlan=false, retain=false 2023-02-09 06:03:16,046 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:16,046 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:16,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:16,128 INFO [jenkins-hbase4:38867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:16,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3685e622e5d3c685e417a389601a9d54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,129 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675922596129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922596129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922596129"}]},"ts":"1675922596129"} 2023-02-09 06:03:16,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3685e622e5d3c685e417a389601a9d54, server=jenkins-hbase4.apache.org,41927,1675922594867}] 2023-02-09 06:03:16,202 INFO [RS:0;jenkins-hbase4:41927] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41927%2C1675922594867, suffix=, logDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,41927,1675922594867, archiveDir=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs, maxLogs=32 2023-02-09 06:03:16,224 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK] 2023-02-09 06:03:16,224 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK] 2023-02-09 06:03:16,227 INFO [RS:0;jenkins-hbase4:41927] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/WALs/jenkins-hbase4.apache.org,41927,1675922594867/jenkins-hbase4.apache.org%2C41927%2C1675922594867.1675922596203 2023-02-09 06:03:16,227 DEBUG [RS:0;jenkins-hbase4:41927] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39881,DS-f34df7a7-a5f2-4ebb-854c-fdb12891532e,DISK], DatanodeInfoWithStorage[127.0.0.1:37693,DS-8673df65-bfd1-4899-8382-738248cc404e,DISK]] 2023-02-09 06:03:16,248 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:16,248 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:16,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:16,284 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,284 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:16,285 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:16,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3685e622e5d3c685e417a389601a9d54, NAME => 'testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:16,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:16,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,290 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,292 DEBUG [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1 2023-02-09 06:03:16,292 DEBUG [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1 2023-02-09 06:03:16,292 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3685e622e5d3c685e417a389601a9d54 columnFamilyName f1 2023-02-09 06:03:16,293 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] regionserver.HStore(310): Store=3685e622e5d3c685e417a389601a9d54/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:16,293 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,294 DEBUG [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2 2023-02-09 06:03:16,294 DEBUG [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2 2023-02-09 06:03:16,294 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3685e622e5d3c685e417a389601a9d54 columnFamilyName f2 2023-02-09 06:03:16,295 INFO [StoreOpener-3685e622e5d3c685e417a389601a9d54-1] regionserver.HStore(310): Store=3685e622e5d3c685e417a389601a9d54/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:16,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:16,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:16,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:16,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3685e622e5d3c685e417a389601a9d54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70595638, jitterRate=0.05195698142051697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:16,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3685e622e5d3c685e417a389601a9d54: Running coprocessor pre-open hook at 1675922596289Writing region info on filesystem at 1675922596289Initializing all the Stores at 1675922596290 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922596290Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922596290Cleaning up temporary data from old regions at 1675922596296 (+6 ms)Cleaning up detritus from prior splits at 1675922596296Running coprocessor post-open hooks at 1675922596301 (+5 ms)Region opened successfully at 1675922596301 2023-02-09 06:03:16,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54., pid=12, masterSystemTime=1675922596284 2023-02-09 06:03:16,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3685e622e5d3c685e417a389601a9d54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675922596305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922596305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922596305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922596305"}]},"ts":"1675922596305"} 2023-02-09 06:03:16,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 06:03:16,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3685e622e5d3c685e417a389601a9d54, server=jenkins-hbase4.apache.org,41927,1675922594867 in 176 msec 2023-02-09 06:03:16,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 06:03:16,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, ASSIGN in 333 msec 2023-02-09 06:03:16,310 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:16,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922596310"}]},"ts":"1675922596310"} 2023-02-09 06:03:16,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-09 06:03:16,314 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:16,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 373 msec 2023-02-09 06:03:16,550 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:16,550 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:16,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:16,551 INFO [Listener at localhost/44245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-09 06:03:16,551 DEBUG [Listener at localhost/44245] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-09 06:03:16,552 INFO [Listener at localhost/44245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:16,554 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-09 06:03:16,554 INFO [Listener at localhost/44245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:16,554 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-09 06:03:16,554 INFO [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:16,577 DEBUG [hconnection-0x4ac18348-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:16,593 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:16,600 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41927] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,653 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 06:03:16,752 INFO [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:16,752 INFO [Listener at localhost/44245] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:16,752 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:16,752 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:16,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 06:03:16,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922596753 (current time:1675922596753). 2023-02-09 06:03:16,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:16,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] zookeeper.ReadOnlyZKClient(139): Connect 0x610df745 to 127.0.0.1:64032 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:16,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5efdaf27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:16,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:16,761 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:16,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x610df745 to 127.0.0.1:64032 2023-02-09 06:03:16,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 06:03:16,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 06:03:16,766 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 06:03:16,767 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675923196767 2023-02-09 06:03:16,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 06:03:16,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:16,768 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:16,768 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:16,769 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 06:03:16,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 06:03:16,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-09 06:03:16,771 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 06:03:16,771 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675923196771 2023-02-09 06:03:16,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 06:03:16,780 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 06:03:16,781 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:16,781 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 06:03:16,781 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 06:03:16,782 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,782 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,784 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:16,784 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,784 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:16,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:16,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:16,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:16,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:16,784 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,785 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 06:03:16,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 06:03:16,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 06:03:16,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 06:03:16,786 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 06:03:16,786 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:16,787 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 06:03:16,787 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 06:03:16,787 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39153,1675922594899' joining acquired barrier for procedure (foo) in zk 2023-02-09 06:03:16,787 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 06:03:16,787 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 06:03:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 06:03:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41927,1675922594867' joining acquired barrier for procedure (foo) in zk 2023-02-09 06:03:16,789 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:16,790 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:16,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41927,1675922594867' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 06:03:16,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@413492bc[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:16,792 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 06:03:16,792 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,793 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,794 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 06:03:16,794 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:16,794 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39153,1675922594899' in zk 2023-02-09 06:03:16,794 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,794 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. started... 2023-02-09 06:03:16,795 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3685e622e5d3c685e417a389601a9d54 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 06:03:16,798 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 06:03:16,798 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:16,798 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 06:03:16,817 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f1/6486812cb5eb40208a01e354b34c9472 2023-02-09 06:03:16,842 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f2/27596d2f7b4649d481a7876a1c924001 2023-02-09 06:03:16,847 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f1/6486812cb5eb40208a01e354b34c9472 as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472 2023-02-09 06:03:16,851 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:16,851 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f2/27596d2f7b4649d481a7876a1c924001 as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001 2023-02-09 06:03:16,855 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:16,856 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3685e622e5d3c685e417a389601a9d54 in 61ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:16,856 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3685e622e5d3c685e417a389601a9d54: 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.' region-info for snapshot=foo 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472] hfiles 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472 for snapshot=foo 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001] hfiles 2023-02-09 06:03:16,857 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001 for snapshot=foo 2023-02-09 06:03:16,864 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. completed. 2023-02-09 06:03:16,864 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 06:03:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 06:03:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 06:03:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41927,1675922594867' in zk 2023-02-09 06:03:16,866 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 06:03:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 06:03:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,869 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:16,869 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:16,870 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 06:03:16,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:16,871 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41927,1675922594867': 2023-02-09 06:03:16,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41927,1675922594867' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 06:03:16,871 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 06:03:16,871 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:16,871 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:16,871 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 06:03:16,871 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:16,873 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:16,873 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,873 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:16,874 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,874 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:16,876 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:16,876 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,882 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:16,882 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:16,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:16,882 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:16,882 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,882 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:16,883 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:16,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 06:03:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:16,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 06:03:16,883 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:16,883 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:16,884 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:16,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:16,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:16,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:16,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/.tmp/foo to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/foo 2023-02-09 06:03:16,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-09 06:03:16,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:16,919 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:16,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675922596767Consolidate snapshot: foo at 1675922596884 (+117 ms)Loading Region manifests for foo at 1675922596884Writing data manifest for foo at 1675922596890 (+6 ms)Verifying snapshot: foo at 1675922596896 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675922596918 (+22 ms) 2023-02-09 06:03:16,920 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 06:03:16,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 152 msec 2023-02-09 06:03:17,071 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:17,071 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,071 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 06:03:17,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:17,073 INFO [Listener at localhost/44245] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:17,073 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,073 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,078 INFO [Listener at localhost/44245] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:17,084 INFO [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:17,129 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41927] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,275 INFO [Listener at localhost/44245] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:17,279 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,279 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:17,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,283 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-09 06:03:17,283 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:17,283 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-09 06:03:17,284 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-09 06:03:17,284 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,284 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,285 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,285 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:17,285 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:17,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:17,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:17,286 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,286 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,292 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 06:03:17,292 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 06:03:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 06:03:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:17,294 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 06:03:17,294 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 06:03:17,294 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:17,294 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 06:03:17,294 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,294 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. started... 2023-02-09 06:03:17,294 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39153,1675922594899' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 06:03:17,294 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3685e622e5d3c685e417a389601a9d54 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 06:03:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:17,310 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f1/4b4a196ddd7c486abfea7d4d41877fae 2023-02-09 06:03:17,328 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f2/3efd5519f0c046f8a3ce461c30399d3d 2023-02-09 06:03:17,333 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f1/4b4a196ddd7c486abfea7d4d41877fae as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/4b4a196ddd7c486abfea7d4d41877fae 2023-02-09 06:03:17,337 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/4b4a196ddd7c486abfea7d4d41877fae, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:17,338 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/.tmp/f2/3efd5519f0c046f8a3ce461c30399d3d as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/3efd5519f0c046f8a3ce461c30399d3d 2023-02-09 06:03:17,342 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/3efd5519f0c046f8a3ce461c30399d3d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:17,343 INFO [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3685e622e5d3c685e417a389601a9d54 in 49ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:17,344 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3685e622e5d3c685e417a389601a9d54: 2023-02-09 06:03:17,344 DEBUG [rs(jenkins-hbase4.apache.org,41927,1675922594867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 06:03:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 06:03:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,345 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 06:03:17,345 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41927,1675922594867' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 06:03:17,346 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,346 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:17,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:17,346 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:17,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41927,1675922594867' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-09 06:03:17,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@450b0e42[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:17,348 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-09 06:03:17,348 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41927,1675922594867' in zk 2023-02-09 06:03:17,351 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,351 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,39153,1675922594899' in zk 2023-02-09 06:03:17,351 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:17,353 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,353 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 06:03:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:17,353 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:17,353 DEBUG [member: 'jenkins-hbase4.apache.org,41927,1675922594867' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 06:03:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 06:03:17,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,39153,1675922594899' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 06:03:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:17,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,41927,1675922594867': 2023-02-09 06:03:17,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41927,1675922594867' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-09 06:03:17,358 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-09 06:03:17,358 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:17,358 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:17,358 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,358 INFO [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:17,360 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:17,360 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:17,360 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:17,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:17,360 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,361 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:17,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,362 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,362 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:17,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:17,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:17,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:17,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:17,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:17,366 DEBUG [(jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:17,366 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,367 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:17,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-09 06:03:17,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:17,367 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,367 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:17,368 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:17,468 DEBUG [Listener at localhost/44245] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:17,468 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,469 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:17,474 INFO [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675922596753 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:17,475 DEBUG [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44673/user/jenkins/test-data/289a1c17-322e-eccf-8b09-e2beab5957ee/foo/a630bc1f-e428-4f3d-8fb4-37cd53a347e6/data/default/testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,475 INFO [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(239): region to add: 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:17,475 INFO [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(585): clone region=3685e622e5d3c685e417a389601a9d54 as 3685e622e5d3c685e417a389601a9d54 in snapshot foo 2023-02-09 06:03:17,476 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3685e622e5d3c685e417a389601a9d54, NAME => 'testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44673/user/jenkins/test-data/289a1c17-322e-eccf-8b09-e2beab5957ee/foo/a630bc1f-e428-4f3d-8fb4-37cd53a347e6 2023-02-09 06:03:17,483 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:17,483 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6486812cb5eb40208a01e354b34c9472 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,485 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27596d2f7b4649d481a7876a1c924001 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,487 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3685e622e5d3c685e417a389601a9d54, disabling compactions & flushes 2023-02-09 06:03:17,487 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,487 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,487 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. after waiting 0 ms 2023-02-09 06:03:17,487 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,487 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,487 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3685e622e5d3c685e417a389601a9d54: Waiting for close lock at 1675922597487Disabling compacts and flushes for region at 1675922597487Disabling writes for close at 1675922597487Writing region close event to WAL at 1675922597487Closed at 1675922597487 2023-02-09 06:03:17,487 INFO [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675922596753 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:17,487 DEBUG [Listener at localhost/44245] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44673/user/jenkins/test-data/289a1c17-322e-eccf-8b09-e2beab5957ee/foo/a630bc1f-e428-4f3d-8fb4-37cd53a347e6 2023-02-09 06:03:17,487 DEBUG [Listener at localhost/44245] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44673/user/jenkins/test-data/289a1c17-322e-eccf-8b09-e2beab5957ee/foo/a630bc1f-e428-4f3d-8fb4-37cd53a347e6 2023-02-09 06:03:17,488 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:17,489 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:17,489 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-09 06:03:17,489 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |----------3685e622e5d3c685e417a389601a9d54/ 2023-02-09 06:03:17,490 DEBUG [Listener at localhost/44245] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:17,490 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:17,490 DEBUG [Listener at localhost/44245] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=3685e622e5d3c685e417a389601a9d54-6486812cb5eb40208a01e354b34c9472 2023-02-09 06:03:17,490 DEBUG [Listener at localhost/44245] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:17,491 DEBUG [Listener at localhost/44245] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=3685e622e5d3c685e417a389601a9d54-27596d2f7b4649d481a7876a1c924001 2023-02-09 06:03:17,491 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,491 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 06:03:17,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 06:03:17,495 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,495 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,496 INFO [Listener at localhost/44245] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,499 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,499 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:17,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922597499"}]},"ts":"1675922597499"} 2023-02-09 06:03:17,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-09 06:03:17,502 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-09 06:03:17,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, UNASSIGN}] 2023-02-09 06:03:17,504 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, UNASSIGN 2023-02-09 06:03:17,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3685e622e5d3c685e417a389601a9d54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:17,505 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675922597505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922597505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922597505"}]},"ts":"1675922597505"} 2023-02-09 06:03:17,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3685e622e5d3c685e417a389601a9d54, server=jenkins-hbase4.apache.org,41927,1675922594867}] 2023-02-09 06:03:17,600 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,600 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:17,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:17,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3685e622e5d3c685e417a389601a9d54, disabling compactions & flushes 2023-02-09 06:03:17,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. after waiting 0 ms 2023-02-09 06:03:17,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:17,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54. 2023-02-09 06:03:17,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3685e622e5d3c685e417a389601a9d54: Waiting for close lock at 1675922597658Running coprocessor pre-close hooks at 1675922597658Disabling compacts and flushes for region at 1675922597658Disabling writes for close at 1675922597658Writing region close event to WAL at 1675922597659 (+1 ms)Running coprocessor post-close hooks at 1675922597663 (+4 ms)Closed at 1675922597663 2023-02-09 06:03:17,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:17,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3685e622e5d3c685e417a389601a9d54, regionState=CLOSED 2023-02-09 06:03:17,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675922597665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922597665"}]},"ts":"1675922597665"} 2023-02-09 06:03:17,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 06:03:17,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3685e622e5d3c685e417a389601a9d54, server=jenkins-hbase4.apache.org,41927,1675922594867 in 161 msec 2023-02-09 06:03:17,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 06:03:17,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3685e622e5d3c685e417a389601a9d54, UNASSIGN in 165 msec 2023-02-09 06:03:17,670 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922597670"}]},"ts":"1675922597670"} 2023-02-09 06:03:17,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-09 06:03:17,673 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-09 06:03:17,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-09 06:03:17,801 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,802 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:17,803 INFO [Listener at localhost/44245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-09 06:03:17,803 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,803 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,807 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,807 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,807 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:17,810 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:17,812 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1, FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2, FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/recovered.edits] 2023-02-09 06:03:17,815 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/4b4a196ddd7c486abfea7d4d41877fae to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/archive/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/4b4a196ddd7c486abfea7d4d41877fae 2023-02-09 06:03:17,817 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472 to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/archive/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f1/6486812cb5eb40208a01e354b34c9472 2023-02-09 06:03:17,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001 to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/archive/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/27596d2f7b4649d481a7876a1c924001 2023-02-09 06:03:17,820 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/3efd5519f0c046f8a3ce461c30399d3d to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/archive/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/f2/3efd5519f0c046f8a3ce461c30399d3d 2023-02-09 06:03:17,823 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/recovered.edits/12.seqid to hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/archive/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54/recovered.edits/12.seqid 2023-02-09 06:03:17,823 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3685e622e5d3c685e417a389601a9d54 2023-02-09 06:03:17,823 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 06:03:17,825 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,827 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-09 06:03:17,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-09 06:03:17,830 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,830 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-09 06:03:17,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922597830"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:17,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 06:03:17,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3685e622e5d3c685e417a389601a9d54, NAME => 'testInitTableSnapshotMapperJobConfig,,1675922595941.3685e622e5d3c685e417a389601a9d54.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 06:03:17,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-09 06:03:17,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922597831"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:17,835 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-09 06:03:17,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 06:03:17,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-09 06:03:17,908 INFO [Listener at localhost/44245] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:17,908 INFO [Listener at localhost/44245] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:17,910 INFO [Listener at localhost/44245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-09 06:03:17,910 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:17,910 INFO [Listener at localhost/44245] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:17,910 DEBUG [Listener at localhost/44245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54c013c9 to 127.0.0.1:64032 2023-02-09 06:03:17,910 DEBUG [Listener at localhost/44245] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:17,910 DEBUG [Listener at localhost/44245] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:17,910 DEBUG [Listener at localhost/44245] util.JVMClusterUtil(257): Found active master hash=437620701, stopped=false 2023-02-09 06:03:17,910 INFO [Listener at localhost/44245] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:18,107 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:18,107 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:18,107 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:18,107 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:18,107 INFO [Listener at localhost/44245] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:18,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:18,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:18,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:18,109 DEBUG [Listener at localhost/44245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d4ff741 to 127.0.0.1:64032 2023-02-09 06:03:18,109 DEBUG [Listener at localhost/44245] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,110 INFO [Listener at localhost/44245] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41927,1675922594867' ***** 2023-02-09 06:03:18,110 INFO [Listener at localhost/44245] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:18,110 INFO [Listener at localhost/44245] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39153,1675922594899' ***** 2023-02-09 06:03:18,110 INFO [Listener at localhost/44245] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:18,110 INFO [RS:0;jenkins-hbase4:41927] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:18,110 INFO [RS:1;jenkins-hbase4:39153] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:18,110 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:18,111 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:18,111 INFO [RS:0;jenkins-hbase4:41927] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:18,111 INFO [RS:1;jenkins-hbase4:39153] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:18,112 INFO [RS:0;jenkins-hbase4:41927] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:18,112 INFO [RS:1;jenkins-hbase4:39153] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:18,112 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:18,112 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(3304): Received CLOSE for 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:18,112 DEBUG [RS:0;jenkins-hbase4:41927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12c72740 to 127.0.0.1:64032 2023-02-09 06:03:18,112 DEBUG [RS:0;jenkins-hbase4:41927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,112 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41927,1675922594867; all regions closed. 2023-02-09 06:03:18,112 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:18,112 DEBUG [RS:1;jenkins-hbase4:39153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1548537c to 127.0.0.1:64032 2023-02-09 06:03:18,112 DEBUG [RS:1;jenkins-hbase4:39153] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,112 INFO [RS:1;jenkins-hbase4:39153] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:18,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3dd3a8ba16f6787739538c6e00a58738, disabling compactions & flushes 2023-02-09 06:03:18,113 INFO [RS:1;jenkins-hbase4:39153] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:18,113 INFO [RS:1;jenkins-hbase4:39153] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:18,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:18,113 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:18,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:18,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. after waiting 0 ms 2023-02-09 06:03:18,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:18,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3dd3a8ba16f6787739538c6e00a58738 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:18,113 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 06:03:18,113 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 3dd3a8ba16f6787739538c6e00a58738=hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738.} 2023-02-09 06:03:18,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:18,114 DEBUG [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1505): Waiting on 1588230740, 3dd3a8ba16f6787739538c6e00a58738 2023-02-09 06:03:18,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:18,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:18,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:18,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:18,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-09 06:03:18,118 DEBUG [RS:0;jenkins-hbase4:41927] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs 2023-02-09 06:03:18,118 INFO [RS:0;jenkins-hbase4:41927] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41927%2C1675922594867:(num 1675922596203) 2023-02-09 06:03:18,118 DEBUG [RS:0;jenkins-hbase4:41927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,118 INFO [RS:0;jenkins-hbase4:41927] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:18,119 INFO [RS:0;jenkins-hbase4:41927] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:18,119 INFO [RS:0;jenkins-hbase4:41927] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:18,119 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:18,119 INFO [RS:0;jenkins-hbase4:41927] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:18,119 INFO [RS:0;jenkins-hbase4:41927] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:18,120 INFO [RS:0;jenkins-hbase4:41927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41927 2023-02-09 06:03:18,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/.tmp/info/c51817aaa8f54b7c925638d4e69a30ba 2023-02-09 06:03:18,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/info/b1a3e04170fc4329b67f59bbaad9d32c 2023-02-09 06:03:18,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1a3e04170fc4329b67f59bbaad9d32c 2023-02-09 06:03:18,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/.tmp/info/c51817aaa8f54b7c925638d4e69a30ba as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/info/c51817aaa8f54b7c925638d4e69a30ba 2023-02-09 06:03:18,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/info/c51817aaa8f54b7c925638d4e69a30ba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:18,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3dd3a8ba16f6787739538c6e00a58738 in 25ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:18,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/rep_barrier/d56d61eb61f74992bc03189bcd5fef11 2023-02-09 06:03:18,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/namespace/3dd3a8ba16f6787739538c6e00a58738/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:18,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:18,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3dd3a8ba16f6787739538c6e00a58738: Waiting for close lock at 1675922598112Running coprocessor pre-close hooks at 1675922598112Disabling compacts and flushes for region at 1675922598112Disabling writes for close at 1675922598113 (+1 ms)Obtaining lock to block concurrent updates at 1675922598113Preparing flush snapshotting stores in 3dd3a8ba16f6787739538c6e00a58738 at 1675922598113Finished memstore snapshotting hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922598114 (+1 ms)Flushing stores of hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. at 1675922598115 (+1 ms)Flushing 3dd3a8ba16f6787739538c6e00a58738/info: creating writer at 1675922598115Flushing 3dd3a8ba16f6787739538c6e00a58738/info: appending metadata at 1675922598118 (+3 ms)Flushing 3dd3a8ba16f6787739538c6e00a58738/info: closing flushed file at 1675922598118Flushing 3dd3a8ba16f6787739538c6e00a58738/info: reopening flushed file at 1675922598133 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3dd3a8ba16f6787739538c6e00a58738 in 25ms, sequenceid=6, compaction requested=false at 1675922598139 (+6 ms)Writing region close event to WAL at 1675922598144 (+5 ms)Running coprocessor post-close hooks at 1675922598148 (+4 ms)Closed at 1675922598148 2023-02-09 06:03:18,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922595478.3dd3a8ba16f6787739538c6e00a58738. 2023-02-09 06:03:18,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d56d61eb61f74992bc03189bcd5fef11 2023-02-09 06:03:18,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/table/ea4e9f95746447c7a76e71462a80e304 2023-02-09 06:03:18,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea4e9f95746447c7a76e71462a80e304 2023-02-09 06:03:18,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/info/b1a3e04170fc4329b67f59bbaad9d32c as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/info/b1a3e04170fc4329b67f59bbaad9d32c 2023-02-09 06:03:18,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1a3e04170fc4329b67f59bbaad9d32c 2023-02-09 06:03:18,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/info/b1a3e04170fc4329b67f59bbaad9d32c, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 06:03:18,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/rep_barrier/d56d61eb61f74992bc03189bcd5fef11 as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/rep_barrier/d56d61eb61f74992bc03189bcd5fef11 2023-02-09 06:03:18,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d56d61eb61f74992bc03189bcd5fef11 2023-02-09 06:03:18,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/rep_barrier/d56d61eb61f74992bc03189bcd5fef11, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 06:03:18,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/.tmp/table/ea4e9f95746447c7a76e71462a80e304 as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/table/ea4e9f95746447c7a76e71462a80e304 2023-02-09 06:03:18,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea4e9f95746447c7a76e71462a80e304 2023-02-09 06:03:18,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/table/ea4e9f95746447c7a76e71462a80e304, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 06:03:18,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false 2023-02-09 06:03:18,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 06:03:18,190 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:18,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:18,191 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:18,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922598113Running coprocessor pre-close hooks at 1675922598113Disabling compacts and flushes for region at 1675922598113Disabling writes for close at 1675922598114 (+1 ms)Obtaining lock to block concurrent updates at 1675922598114Preparing flush snapshotting stores in 1588230740 at 1675922598114Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675922598115 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675922598116 (+1 ms)Flushing 1588230740/info: creating writer at 1675922598116Flushing 1588230740/info: appending metadata at 1675922598118 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675922598118Flushing 1588230740/rep_barrier: creating writer at 1675922598132 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922598135 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922598135Flushing 1588230740/table: creating writer at 1675922598151 (+16 ms)Flushing 1588230740/table: appending metadata at 1675922598153 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675922598153Flushing 1588230740/info: reopening flushed file at 1675922598170 (+17 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922598176 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675922598181 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false at 1675922598186 (+5 ms)Writing region close event to WAL at 1675922598187 (+1 ms)Running coprocessor post-close hooks at 1675922598190 (+3 ms)Closed at 1675922598191 (+1 ms) 2023-02-09 06:03:18,191 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 06:03:18,191 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:18,192 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 06:03:18,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:18,222 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:18,222 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41927,1675922594867 2023-02-09 06:03:18,223 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:18,222 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:18,223 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:18,223 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42407174 rejected from java.util.concurrent.ThreadPoolExecutor@467ffde4[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,223 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41927,1675922594867] 2023-02-09 06:03:18,223 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41927,1675922594867; numProcessing=1 2023-02-09 06:03:18,314 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39153,1675922594899; all regions closed. 2023-02-09 06:03:18,321 DEBUG [RS:1;jenkins-hbase4:39153] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs 2023-02-09 06:03:18,321 INFO [RS:1;jenkins-hbase4:39153] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39153%2C1675922594899.meta:.meta(num 1675922595423) 2023-02-09 06:03:18,324 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41927,1675922594867 already deleted, retry=false 2023-02-09 06:03:18,324 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41927,1675922594867 expired; onlineServers=1 2023-02-09 06:03:18,327 DEBUG [RS:1;jenkins-hbase4:39153] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/oldWALs 2023-02-09 06:03:18,327 INFO [RS:1;jenkins-hbase4:39153] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39153%2C1675922594899:(num 1675922595826) 2023-02-09 06:03:18,327 DEBUG [RS:1;jenkins-hbase4:39153] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,327 INFO [RS:1;jenkins-hbase4:39153] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:18,327 INFO [RS:1;jenkins-hbase4:39153] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:18,327 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:18,328 INFO [RS:1;jenkins-hbase4:39153] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39153 2023-02-09 06:03:18,330 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39153,1675922594899 2023-02-09 06:03:18,330 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:18,330 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c58e74e rejected from java.util.concurrent.ThreadPoolExecutor@2867761d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,338 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39153,1675922594899] 2023-02-09 06:03:18,338 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39153,1675922594899; numProcessing=2 2023-02-09 06:03:18,346 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39153,1675922594899 already deleted, retry=false 2023-02-09 06:03:18,346 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39153,1675922594899 expired; onlineServers=0 2023-02-09 06:03:18,346 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38867,1675922594814' ***** 2023-02-09 06:03:18,346 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:18,347 DEBUG [M:0;jenkins-hbase4:38867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e2a0847, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:18,347 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38867,1675922594814 2023-02-09 06:03:18,347 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38867,1675922594814; all regions closed. 2023-02-09 06:03:18,347 DEBUG [M:0;jenkins-hbase4:38867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:18,347 DEBUG [M:0;jenkins-hbase4:38867] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:18,347 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:18,347 DEBUG [M:0;jenkins-hbase4:38867] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:18,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922595065] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922595065,5,FailOnTimeoutGroup] 2023-02-09 06:03:18,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922595065] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922595065,5,FailOnTimeoutGroup] 2023-02-09 06:03:18,348 INFO [M:0;jenkins-hbase4:38867] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:18,349 INFO [M:0;jenkins-hbase4:38867] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:18,349 INFO [M:0;jenkins-hbase4:38867] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:18,349 DEBUG [M:0;jenkins-hbase4:38867] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:18,349 INFO [M:0;jenkins-hbase4:38867] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:18,350 ERROR [M:0;jenkins-hbase4:38867] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:18,350 INFO [M:0;jenkins-hbase4:38867] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:18,350 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:18,353 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:18,353 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:18,353 DEBUG [M:0;jenkins-hbase4:38867] zookeeper.ZKUtil(398): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:18,353 WARN [M:0;jenkins-hbase4:38867] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:18,353 INFO [M:0;jenkins-hbase4:38867] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:18,354 INFO [M:0;jenkins-hbase4:38867] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:18,354 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:18,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:18,355 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:18,355 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:18,355 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:18,355 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:18,355 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-09 06:03:18,369 INFO [M:0;jenkins-hbase4:38867] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2147ecbaf54742909d05fa0705f7c673 2023-02-09 06:03:18,374 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2147ecbaf54742909d05fa0705f7c673 as hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2147ecbaf54742909d05fa0705f7c673 2023-02-09 06:03:18,379 INFO [M:0;jenkins-hbase4:38867] regionserver.HStore(1080): Added hdfs://localhost:44673/user/jenkins/test-data/093f74a1-ffdc-a383-1404-272d1386000f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2147ecbaf54742909d05fa0705f7c673, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 06:03:18,380 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-09 06:03:18,380 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:18,381 DEBUG [M:0;jenkins-hbase4:38867] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922598354Disabling compacts and flushes for region at 1675922598354Disabling writes for close at 1675922598355 (+1 ms)Obtaining lock to block concurrent updates at 1675922598355Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922598355Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57220, getHeapSize=68400, getOffHeapSize=0, getCellsCount=145 at 1675922598355Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922598356 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922598356Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922598359 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922598359Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922598375 (+16 ms)Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false at 1675922598380 (+5 ms)Writing region close event to WAL at 1675922598380Closed at 1675922598380 2023-02-09 06:03:18,384 INFO [M:0;jenkins-hbase4:38867] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:18,384 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:18,385 INFO [M:0;jenkins-hbase4:38867] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38867 2023-02-09 06:03:18,388 DEBUG [M:0;jenkins-hbase4:38867] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38867,1675922594814 already deleted, retry=false 2023-02-09 06:03:18,586 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,586 INFO [M:0;jenkins-hbase4:38867] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38867,1675922594814; zookeeper connection closed. 2023-02-09 06:03:18,586 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60c06bd8 rejected from java.util.concurrent.ThreadPoolExecutor@64ffe318[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,587 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): master:38867-0x10037ad45b10000, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,587 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@736be97c rejected from java.util.concurrent.ThreadPoolExecutor@64ffe318[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,686 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,686 INFO [RS:1;jenkins-hbase4:39153] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39153,1675922594899; zookeeper connection closed. 2023-02-09 06:03:18,686 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37cbf1c1 rejected from java.util.concurrent.ThreadPoolExecutor@2867761d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,687 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:39153-0x10037ad45b10002, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,687 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f8640fa rejected from java.util.concurrent.ThreadPoolExecutor@2867761d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,687 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9304151] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9304151 2023-02-09 06:03:18,787 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,787 INFO [RS:0;jenkins-hbase4:41927] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41927,1675922594867; zookeeper connection closed. 2023-02-09 06:03:18,787 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73be7e82 rejected from java.util.concurrent.ThreadPoolExecutor@467ffde4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,787 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61cec48] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61cec48 2023-02-09 06:03:18,787 DEBUG [Listener at localhost/44245-EventThread] zookeeper.ZKWatcher(600): regionserver:41927-0x10037ad45b10001, quorum=127.0.0.1:64032, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:18,787 ERROR [Listener at localhost/44245-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b1d212f rejected from java.util.concurrent.ThreadPoolExecutor@467ffde4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:18,787 INFO [Listener at localhost/44245] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:18,787 WARN [Listener at localhost/44245] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:18,792 INFO [Listener at localhost/44245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:18,897 WARN [BP-1709457913-172.31.14.131-1675922594196 heartbeating to localhost/127.0.0.1:44673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:18,897 WARN [BP-1709457913-172.31.14.131-1675922594196 heartbeating to localhost/127.0.0.1:44673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1709457913-172.31.14.131-1675922594196 (Datanode Uuid b08c219d-2349-49ce-bb1f-afdbb1cff26c) service to localhost/127.0.0.1:44673 2023-02-09 06:03:18,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/dfs/data/data3/current/BP-1709457913-172.31.14.131-1675922594196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:18,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/dfs/data/data4/current/BP-1709457913-172.31.14.131-1675922594196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:18,899 WARN [Listener at localhost/44245] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:18,903 INFO [Listener at localhost/44245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:19,007 WARN [BP-1709457913-172.31.14.131-1675922594196 heartbeating to localhost/127.0.0.1:44673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:19,007 WARN [BP-1709457913-172.31.14.131-1675922594196 heartbeating to localhost/127.0.0.1:44673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1709457913-172.31.14.131-1675922594196 (Datanode Uuid 1bfde75b-406e-4cda-aede-081c354291ad) service to localhost/127.0.0.1:44673 2023-02-09 06:03:19,007 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/dfs/data/data1/current/BP-1709457913-172.31.14.131-1675922594196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:19,008 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/cluster_d88be3e6-2faa-2c4e-535e-d5d11dc46214/dfs/data/data2/current/BP-1709457913-172.31.14.131-1675922594196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:19,018 INFO [Listener at localhost/44245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:19,131 INFO [Listener at localhost/44245] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:19,151 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:19,163 INFO [Listener at localhost/44245] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 159) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44673 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44245 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44673 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38867,1675922594814)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 278) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3620 (was 3713) 2023-02-09 06:03:19,173 INFO [Listener at localhost/44245] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=166, AvailableMemoryMB=3619 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.log.dir so I do NOT create it in target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7 2023-02-09 06:03:19,183 WARN [Listener at localhost/44245] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.tmp.dir so I do NOT create it in target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7 2023-02-09 06:03:19,183 WARN [Listener at localhost/44245] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca9d9a25-7e22-946e-b99a-3c5077af1d4c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:19,183 DEBUG [Listener at localhost/44245] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94, deleteOnExit=true 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/test.cache.data in system properties and HBase conf 2023-02-09 06:03:19,183 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:19,184 DEBUG [Listener at localhost/44245] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:19,184 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:19,185 INFO [Listener at localhost/44245] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:19,189 WARN [Listener at localhost/44245] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:19,189 WARN [Listener at localhost/44245] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:19,226 WARN [Listener at localhost/44245] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:19,228 INFO [Listener at localhost/44245] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:19,232 INFO [Listener at localhost/44245] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/java.io.tmpdir/Jetty_localhost_45197_hdfs____3xaxk/webapp 2023-02-09 06:03:19,323 INFO [Listener at localhost/44245] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45197 2023-02-09 06:03:19,327 WARN [Listener at localhost/44245] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:19,327 WARN [Listener at localhost/44245] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:19,367 WARN [Listener at localhost/40195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:19,383 WARN [Listener at localhost/40195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:19,385 WARN [Listener at localhost/40195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:19,386 INFO [Listener at localhost/40195] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:19,391 INFO [Listener at localhost/40195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/java.io.tmpdir/Jetty_localhost_38219_datanode____.7xat6s/webapp 2023-02-09 06:03:19,488 INFO [Listener at localhost/40195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38219 2023-02-09 06:03:19,500 WARN [Listener at localhost/41055] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:19,520 WARN [Listener at localhost/41055] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:19,522 WARN [Listener at localhost/41055] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:19,523 INFO [Listener at localhost/41055] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:19,527 INFO [Listener at localhost/41055] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/java.io.tmpdir/Jetty_localhost_34405_datanode____wg9stb/webapp 2023-02-09 06:03:19,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa648edc2db7d792: Processing first storage report for DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c from datanode a29b7ec7-2d03-46da-8db0-a108d178aa40 2023-02-09 06:03:19,596 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa648edc2db7d792: from storage DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c node DatanodeRegistration(127.0.0.1:40979, datanodeUuid=a29b7ec7-2d03-46da-8db0-a108d178aa40, infoPort=45317, infoSecurePort=0, ipcPort=41055, storageInfo=lv=-57;cid=testClusterID;nsid=1916744525;c=1675922599192), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:19,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa648edc2db7d792: Processing first storage report for DS-408a4b71-be6e-4e8d-b9ab-667da6c275ae from datanode a29b7ec7-2d03-46da-8db0-a108d178aa40 2023-02-09 06:03:19,596 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa648edc2db7d792: from storage DS-408a4b71-be6e-4e8d-b9ab-667da6c275ae node DatanodeRegistration(127.0.0.1:40979, datanodeUuid=a29b7ec7-2d03-46da-8db0-a108d178aa40, infoPort=45317, infoSecurePort=0, ipcPort=41055, storageInfo=lv=-57;cid=testClusterID;nsid=1916744525;c=1675922599192), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:19,636 INFO [Listener at localhost/41055] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34405 2023-02-09 06:03:19,644 WARN [Listener at localhost/34763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:19,754 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x876a67b755f78519: Processing first storage report for DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7 from datanode 778b97d4-c160-4df9-972e-ddb7c61e8b3b 2023-02-09 06:03:19,754 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x876a67b755f78519: from storage DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7 node DatanodeRegistration(127.0.0.1:36469, datanodeUuid=778b97d4-c160-4df9-972e-ddb7c61e8b3b, infoPort=41681, infoSecurePort=0, ipcPort=34763, storageInfo=lv=-57;cid=testClusterID;nsid=1916744525;c=1675922599192), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:19,754 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x876a67b755f78519: Processing first storage report for DS-ffb6efe8-f88d-4837-ad75-d9b272d15856 from datanode 778b97d4-c160-4df9-972e-ddb7c61e8b3b 2023-02-09 06:03:19,754 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x876a67b755f78519: from storage DS-ffb6efe8-f88d-4837-ad75-d9b272d15856 node DatanodeRegistration(127.0.0.1:36469, datanodeUuid=778b97d4-c160-4df9-972e-ddb7c61e8b3b, infoPort=41681, infoSecurePort=0, ipcPort=34763, storageInfo=lv=-57;cid=testClusterID;nsid=1916744525;c=1675922599192), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:19,758 DEBUG [Listener at localhost/34763] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7 2023-02-09 06:03:19,760 INFO [Listener at localhost/34763] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/zookeeper_0, clientPort=62943, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:19,761 INFO [Listener at localhost/34763] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62943 2023-02-09 06:03:19,761 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,762 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,781 INFO [Listener at localhost/34763] util.FSUtils(479): Created version file at hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e with version=8 2023-02-09 06:03:19,781 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,782 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,784 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/hbase-staging 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,786 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:19,787 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:19,787 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37713 2023-02-09 06:03:19,788 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,789 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,789 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37713 connecting to ZooKeeper ensemble=127.0.0.1:62943 2023-02-09 06:03:19,800 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:377130x0, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:19,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37713-0x10037ad59150000 connected 2023-02-09 06:03:19,822 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:19,823 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:19,823 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:19,824 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37713 2023-02-09 06:03:19,824 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37713 2023-02-09 06:03:19,824 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37713 2023-02-09 06:03:19,829 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37713 2023-02-09 06:03:19,829 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37713 2023-02-09 06:03:19,829 INFO [Listener at localhost/34763] master.HMaster(439): hbase.rootdir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e, hbase.cluster.distributed=false 2023-02-09 06:03:19,841 INFO [Listener at localhost/34763] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:19,842 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:19,843 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38605 2023-02-09 06:03:19,843 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:19,845 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:19,845 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,846 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,847 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38605 connecting to ZooKeeper ensemble=127.0.0.1:62943 2023-02-09 06:03:19,850 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:386050x0, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:19,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38605-0x10037ad59150001 connected 2023-02-09 06:03:19,852 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:19,853 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:19,853 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:19,856 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38605 2023-02-09 06:03:19,856 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38605 2023-02-09 06:03:19,856 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38605 2023-02-09 06:03:19,860 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38605 2023-02-09 06:03:19,860 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38605 2023-02-09 06:03:19,871 INFO [Listener at localhost/34763] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:19,871 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,872 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,872 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:19,872 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:19,872 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:19,872 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:19,873 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40129 2023-02-09 06:03:19,873 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:19,874 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:19,874 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,875 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,876 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40129 connecting to ZooKeeper ensemble=127.0.0.1:62943 2023-02-09 06:03:19,880 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:401290x0, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:19,881 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:401290x0, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:19,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40129-0x10037ad59150002 connected 2023-02-09 06:03:19,882 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:19,882 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:19,888 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40129 2023-02-09 06:03:19,888 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40129 2023-02-09 06:03:19,888 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40129 2023-02-09 06:03:19,889 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40129 2023-02-09 06:03:19,889 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40129 2023-02-09 06:03:19,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:19,892 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:19,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:19,894 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:19,894 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:19,894 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:19,895 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:19,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:19,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37713,1675922599785 from backup master directory 2023-02-09 06:03:19,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:19,898 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:19,898 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:19,898 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:19,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:19,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/hbase.id with ID: 2d201d56-1789-40fe-a07a-fa5391ab1050 2023-02-09 06:03:19,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:19,926 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:19,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2177d5c6 to 127.0.0.1:62943 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:19,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7d2c76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:19,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:19,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:19,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store-tmp 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:19,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:19,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922599947Disabling compacts and flushes for region at 1675922599947Disabling writes for close at 1675922599947Writing region close event to WAL at 1675922599947Closed at 1675922599947 2023-02-09 06:03:19,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/WALs/jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:19,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37713%2C1675922599785, suffix=, logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/WALs/jenkins-hbase4.apache.org,37713,1675922599785, archiveDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:19,964 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK] 2023-02-09 06:03:19,965 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK] 2023-02-09 06:03:19,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/WALs/jenkins-hbase4.apache.org,37713,1675922599785/jenkins-hbase4.apache.org%2C37713%2C1675922599785.1675922599950 2023-02-09 06:03:19,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK], DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK]] 2023-02-09 06:03:19,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:19,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:19,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,972 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,973 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:19,974 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:19,974 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:19,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:19,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:19,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58891613, jitterRate=-0.12244658172130585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:19,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922599968Initializing all the Stores at 1675922599969 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922599969Cleaning up temporary data from old regions at 1675922599976 (+7 ms)Cleaning up detritus from prior splits at 1675922599976Region opened successfully at 1675922599980 (+4 ms) 2023-02-09 06:03:19,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:19,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:19,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:19,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:19,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:19,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:19,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:19,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:19,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:20,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:20,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:20,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:20,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:20,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:20,010 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:20,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:20,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:20,013 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:20,013 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:20,013 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,013 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:20,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37713,1675922599785, sessionid=0x10037ad59150000, setting cluster-up flag (Was=false) 2023-02-09 06:03:20,018 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:20,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:20,026 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:20,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:20,031 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/.tmp 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922630037 2023-02-09 06:03:20,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:20,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:20,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:20,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:20,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:20,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:20,038 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:20,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,038 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:20,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922600039,5,FailOnTimeoutGroup] 2023-02-09 06:03:20,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922600039,5,FailOnTimeoutGroup] 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,039 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:20,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:20,050 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:20,050 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e 2023-02-09 06:03:20,056 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:20,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:20,061 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/info 2023-02-09 06:03:20,061 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:20,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:20,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:20,064 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:20,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:20,066 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/table 2023-02-09 06:03:20,066 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:20,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,067 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740 2023-02-09 06:03:20,067 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740 2023-02-09 06:03:20,069 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:20,070 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:20,072 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:20,073 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69936272, jitterRate=0.042131662368774414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922600057Initializing all the Stores at 1675922600057Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922600057Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922600060 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922600060Cleaning up temporary data from old regions at 1675922600068 (+8 ms)Cleaning up detritus from prior splits at 1675922600069 (+1 ms)Region opened successfully at 1675922600073 (+4 ms) 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:20,073 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:20,073 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:20,073 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922600073Disabling compacts and flushes for region at 1675922600073Disabling writes for close at 1675922600073Writing region close event to WAL at 1675922600073Closed at 1675922600073 2023-02-09 06:03:20,074 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:20,074 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:20,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:20,076 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:20,077 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:20,091 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(952): ClusterId : 2d201d56-1789-40fe-a07a-fa5391ab1050 2023-02-09 06:03:20,091 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(952): ClusterId : 2d201d56-1789-40fe-a07a-fa5391ab1050 2023-02-09 06:03:20,091 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:20,091 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:20,094 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:20,094 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:20,094 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:20,094 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:20,096 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:20,097 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:20,097 DEBUG [RS:1;jenkins-hbase4:40129] zookeeper.ReadOnlyZKClient(139): Connect 0x67397cdc to 127.0.0.1:62943 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:20,098 DEBUG [RS:0;jenkins-hbase4:38605] zookeeper.ReadOnlyZKClient(139): Connect 0x3a13adf9 to 127.0.0.1:62943 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:20,108 DEBUG [RS:1;jenkins-hbase4:40129] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69fe9e4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:20,109 DEBUG [RS:1;jenkins-hbase4:40129] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dc117ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:20,109 DEBUG [RS:0;jenkins-hbase4:38605] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d444cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:20,109 DEBUG [RS:0;jenkins-hbase4:38605] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ebc689, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:20,118 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38605 2023-02-09 06:03:20,118 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40129 2023-02-09 06:03:20,118 INFO [RS:0;jenkins-hbase4:38605] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:20,118 INFO [RS:0;jenkins-hbase4:38605] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:20,118 INFO [RS:1;jenkins-hbase4:40129] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:20,118 INFO [RS:1;jenkins-hbase4:40129] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:20,118 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:20,118 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:20,119 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37713,1675922599785 with isa=jenkins-hbase4.apache.org/172.31.14.131:38605, startcode=1675922599841 2023-02-09 06:03:20,119 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37713,1675922599785 with isa=jenkins-hbase4.apache.org/172.31.14.131:40129, startcode=1675922599871 2023-02-09 06:03:20,119 DEBUG [RS:0;jenkins-hbase4:38605] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:20,119 DEBUG [RS:1;jenkins-hbase4:40129] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:20,121 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41257, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:20,121 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47233, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:20,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37713] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,123 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,124 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e 2023-02-09 06:03:20,124 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e 2023-02-09 06:03:20,124 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40195 2023-02-09 06:03:20,124 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40195 2023-02-09 06:03:20,124 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:20,124 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:20,125 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:20,129 DEBUG [RS:1;jenkins-hbase4:40129] zookeeper.ZKUtil(162): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,130 WARN [RS:1;jenkins-hbase4:40129] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:20,130 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40129,1675922599871] 2023-02-09 06:03:20,130 DEBUG [RS:0;jenkins-hbase4:38605] zookeeper.ZKUtil(162): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,130 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38605,1675922599841] 2023-02-09 06:03:20,130 WARN [RS:0;jenkins-hbase4:38605] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:20,130 INFO [RS:1;jenkins-hbase4:40129] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:20,130 INFO [RS:0;jenkins-hbase4:38605] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:20,130 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,130 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,141 DEBUG [RS:1;jenkins-hbase4:40129] zookeeper.ZKUtil(162): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,141 DEBUG [RS:0;jenkins-hbase4:38605] zookeeper.ZKUtil(162): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,141 DEBUG [RS:1;jenkins-hbase4:40129] zookeeper.ZKUtil(162): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,141 DEBUG [RS:0;jenkins-hbase4:38605] zookeeper.ZKUtil(162): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,142 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:20,142 INFO [RS:1;jenkins-hbase4:40129] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:20,142 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:20,143 INFO [RS:0;jenkins-hbase4:38605] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:20,143 INFO [RS:1;jenkins-hbase4:40129] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:20,144 INFO [RS:1;jenkins-hbase4:40129] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:20,144 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,148 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:20,149 INFO [RS:0;jenkins-hbase4:38605] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:20,149 INFO [RS:0;jenkins-hbase4:38605] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:20,149 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,151 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:20,151 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,152 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,153 DEBUG [RS:1;jenkins-hbase4:40129] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,153 DEBUG [RS:0;jenkins-hbase4:38605] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:20,156 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,156 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,156 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,156 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,156 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,156 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,167 INFO [RS:0;jenkins-hbase4:38605] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:20,167 INFO [RS:1;jenkins-hbase4:40129] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:20,167 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38605,1675922599841-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,167 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40129,1675922599871-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,177 INFO [RS:0;jenkins-hbase4:38605] regionserver.Replication(203): jenkins-hbase4.apache.org,38605,1675922599841 started 2023-02-09 06:03:20,177 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38605,1675922599841, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38605, sessionid=0x10037ad59150001 2023-02-09 06:03:20,177 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:20,177 DEBUG [RS:0;jenkins-hbase4:38605] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,177 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38605,1675922599841' 2023-02-09 06:03:20,177 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:20,177 INFO [RS:1;jenkins-hbase4:40129] regionserver.Replication(203): jenkins-hbase4.apache.org,40129,1675922599871 started 2023-02-09 06:03:20,178 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40129,1675922599871, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40129, sessionid=0x10037ad59150002 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40129,1675922599871' 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38605,1675922599841' 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40129,1675922599871' 2023-02-09 06:03:20,178 DEBUG [RS:0;jenkins-hbase4:38605] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:20,178 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:20,179 DEBUG [RS:0;jenkins-hbase4:38605] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:20,179 DEBUG [RS:1;jenkins-hbase4:40129] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:20,179 INFO [RS:0;jenkins-hbase4:38605] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:20,179 INFO [RS:0;jenkins-hbase4:38605] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:20,179 DEBUG [RS:1;jenkins-hbase4:40129] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:20,179 INFO [RS:1;jenkins-hbase4:40129] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:20,179 INFO [RS:1;jenkins-hbase4:40129] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:20,227 DEBUG [jenkins-hbase4:37713] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:20,227 DEBUG [jenkins-hbase4:37713] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:20,229 DEBUG [jenkins-hbase4:37713] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:20,229 DEBUG [jenkins-hbase4:37713] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:20,229 DEBUG [jenkins-hbase4:37713] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:20,230 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38605,1675922599841, state=OPENING 2023-02-09 06:03:20,231 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:20,232 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,233 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:20,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:20,387 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:20,387 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:20,388 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:20,392 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:20,392 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:20,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38605%2C1675922599841.meta, suffix=.meta, logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,38605,1675922599841, archiveDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs, maxLogs=32 2023-02-09 06:03:20,410 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK] 2023-02-09 06:03:20,410 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK] 2023-02-09 06:03:20,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,38605,1675922599841/jenkins-hbase4.apache.org%2C38605%2C1675922599841.meta.1675922600395.meta 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK], DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK]] 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:20,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:20,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:20,414 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:20,414 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/info 2023-02-09 06:03:20,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/info 2023-02-09 06:03:20,415 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:20,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:20,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:20,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:20,416 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:20,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:20,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/table 2023-02-09 06:03:20,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/table 2023-02-09 06:03:20,418 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:20,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740 2023-02-09 06:03:20,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740 2023-02-09 06:03:20,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:20,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:20,425 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73746403, jitterRate=0.09890703856945038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:20,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922600413Writing region info on filesystem at 1675922600413Initializing all the Stores at 1675922600413Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922600413Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922600413Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922600413Cleaning up temporary data from old regions at 1675922600421 (+8 ms)Cleaning up detritus from prior splits at 1675922600422 (+1 ms)Running coprocessor post-open hooks at 1675922600425 (+3 ms)Region opened successfully at 1675922600425 2023-02-09 06:03:20,426 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922600386 2023-02-09 06:03:20,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:20,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:20,433 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38605,1675922599841, state=OPEN 2023-02-09 06:03:20,435 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:20,435 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:20,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:20,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38605,1675922599841 in 202 msec 2023-02-09 06:03:20,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:20,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-09 06:03:20,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-02-09 06:03:20,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922599892, completionTime=-1 2023-02-09 06:03:20,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:20,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:20,442 DEBUG [hconnection-0x2ef0a4b9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:20,443 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:20,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:20,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922660445 2023-02-09 06:03:20,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922720445 2023-02-09 06:03:20,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37713,1675922599785-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37713,1675922599785-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37713,1675922599785-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37713, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:20,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:20,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:20,454 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:20,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:20,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:20,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f empty. 2023-02-09 06:03:20,458 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:20,471 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:20,472 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => da0ea5de7741c5eca33c43886a3f707f, NAME => 'hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing da0ea5de7741c5eca33c43886a3f707f, disabling compactions & flushes 2023-02-09 06:03:20,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. after waiting 0 ms 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for da0ea5de7741c5eca33c43886a3f707f: Waiting for close lock at 1675922600481Disabling compacts and flushes for region at 1675922600481Disabling writes for close at 1675922600481Writing region close event to WAL at 1675922600481Closed at 1675922600481 2023-02-09 06:03:20,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:20,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922600485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922600485"}]},"ts":"1675922600485"} 2023-02-09 06:03:20,487 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:20,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:20,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922600488"}]},"ts":"1675922600488"} 2023-02-09 06:03:20,489 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:20,492 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:20,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:20,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:20,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:20,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=da0ea5de7741c5eca33c43886a3f707f, ASSIGN}] 2023-02-09 06:03:20,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=da0ea5de7741c5eca33c43886a3f707f, ASSIGN 2023-02-09 06:03:20,502 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=da0ea5de7741c5eca33c43886a3f707f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:20,652 INFO [jenkins-hbase4:37713] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:20,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=da0ea5de7741c5eca33c43886a3f707f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922600654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922600654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922600654"}]},"ts":"1675922600654"} 2023-02-09 06:03:20,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure da0ea5de7741c5eca33c43886a3f707f, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:20,809 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,809 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:20,810 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:20,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,816 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40129%2C1675922599871, suffix=, logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,40129,1675922599871, archiveDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs, maxLogs=32 2023-02-09 06:03:20,831 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK] 2023-02-09 06:03:20,831 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK] 2023-02-09 06:03:20,836 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,40129,1675922599871/jenkins-hbase4.apache.org%2C40129%2C1675922599871.1675922600816 2023-02-09 06:03:20,836 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK], DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK]] 2023-02-09 06:03:20,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da0ea5de7741c5eca33c43886a3f707f, NAME => 'hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:20,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:20,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,840 INFO [StoreOpener-da0ea5de7741c5eca33c43886a3f707f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,841 DEBUG [StoreOpener-da0ea5de7741c5eca33c43886a3f707f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/info 2023-02-09 06:03:20,841 DEBUG [StoreOpener-da0ea5de7741c5eca33c43886a3f707f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/info 2023-02-09 06:03:20,841 INFO [StoreOpener-da0ea5de7741c5eca33c43886a3f707f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da0ea5de7741c5eca33c43886a3f707f columnFamilyName info 2023-02-09 06:03:20,842 INFO [StoreOpener-da0ea5de7741c5eca33c43886a3f707f-1] regionserver.HStore(310): Store=da0ea5de7741c5eca33c43886a3f707f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:20,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:20,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:20,847 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da0ea5de7741c5eca33c43886a3f707f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59814822, jitterRate=-0.10868969559669495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:20,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da0ea5de7741c5eca33c43886a3f707f: Running coprocessor pre-open hook at 1675922600837Writing region info on filesystem at 1675922600837Initializing all the Stores at 1675922600838 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922600838Cleaning up temporary data from old regions at 1675922600843 (+5 ms)Cleaning up detritus from prior splits at 1675922600844 (+1 ms)Running coprocessor post-open hooks at 1675922600847 (+3 ms)Region opened successfully at 1675922600847 2023-02-09 06:03:20,848 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f., pid=6, masterSystemTime=1675922600809 2023-02-09 06:03:20,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,852 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:20,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=da0ea5de7741c5eca33c43886a3f707f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:20,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922600852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922600852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922600852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922600852"}]},"ts":"1675922600852"} 2023-02-09 06:03:20,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:20,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure da0ea5de7741c5eca33c43886a3f707f, server=jenkins-hbase4.apache.org,40129,1675922599871 in 197 msec 2023-02-09 06:03:20,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:20,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=da0ea5de7741c5eca33c43886a3f707f, ASSIGN in 362 msec 2023-02-09 06:03:20,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:20,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922600857"}]},"ts":"1675922600857"} 2023-02-09 06:03:20,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:20,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:20,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 408 msec 2023-02-09 06:03:20,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:20,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:20,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:20,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:20,959 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:20,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:20,969 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:20,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 06:03:20,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:20,980 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:20,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 06:03:20,986 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:20,990 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.092sec 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37713,1675922599785-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:20,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37713,1675922599785-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:20,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:20,992 DEBUG [Listener at localhost/34763] zookeeper.ReadOnlyZKClient(139): Connect 0x728f52ef to 127.0.0.1:62943 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:20,996 DEBUG [Listener at localhost/34763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a6947ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:20,998 DEBUG [hconnection-0x75edd87-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:20,999 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:21,001 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:21,001 DEBUG [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:21,001 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,001 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,003 DEBUG [Listener at localhost/34763] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:21,004 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46766, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:21,005 INFO [Listener at localhost/34763] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,005 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:21,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:46766 deadline: 1675922661005, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,006 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-09 06:03:21,006 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,006 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:21,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:21,011 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-09 06:03:21,011 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,011 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:21,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 empty. 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b empty. 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 empty. 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,021 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 06:03:21,030 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:21,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => ec44993d0312f7a01556e63b6334fcd4, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e4f9d9f31d365985d839e60788163871, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3de757b31d243ac95ceb60a256604797, NAME => 'testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing ec44993d0312f7a01556e63b6334fcd4, disabling compactions & flushes 2023-02-09 06:03:21,040 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. after waiting 0 ms 2023-02-09 06:03:21,040 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,041 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for ec44993d0312f7a01556e63b6334fcd4: Waiting for close lock at 1675922601040Disabling compacts and flushes for region at 1675922601040Disabling writes for close at 1675922601040Writing region close event to WAL at 1675922601041 (+1 ms)Closed at 1675922601041 2023-02-09 06:03:21,041 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e717b28edc8d329a2814bd2f962e04b8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e4f9d9f31d365985d839e60788163871, disabling compactions & flushes 2023-02-09 06:03:21,044 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. after waiting 0 ms 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,044 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,044 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e4f9d9f31d365985d839e60788163871: Waiting for close lock at 1675922601044Disabling compacts and flushes for region at 1675922601044Disabling writes for close at 1675922601044Writing region close event to WAL at 1675922601044Closed at 1675922601044 2023-02-09 06:03:21,045 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 31bb9d0f03ebdf7f0614444194a0bf1f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3de757b31d243ac95ceb60a256604797, disabling compactions & flushes 2023-02-09 06:03:21,048 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. after waiting 0 ms 2023-02-09 06:03:21,048 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,048 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,049 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3de757b31d243ac95ceb60a256604797: Waiting for close lock at 1675922601048Disabling compacts and flushes for region at 1675922601048Disabling writes for close at 1675922601048Writing region close event to WAL at 1675922601048Closed at 1675922601048 2023-02-09 06:03:21,049 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => fa0bd967cfa5ceaa07640c9b2c7c5d58, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e717b28edc8d329a2814bd2f962e04b8, disabling compactions & flushes 2023-02-09 06:03:21,056 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 31bb9d0f03ebdf7f0614444194a0bf1f, disabling compactions & flushes 2023-02-09 06:03:21,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,056 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. after waiting 0 ms 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. after waiting 0 ms 2023-02-09 06:03:21,057 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e717b28edc8d329a2814bd2f962e04b8: Waiting for close lock at 1675922601056Disabling compacts and flushes for region at 1675922601056Disabling writes for close at 1675922601057 (+1 ms)Writing region close event to WAL at 1675922601057Closed at 1675922601057 2023-02-09 06:03:21,057 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,057 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Waiting for close lock at 1675922601056Disabling compacts and flushes for region at 1675922601056Disabling writes for close at 1675922601057 (+1 ms)Writing region close event to WAL at 1675922601057Closed at 1675922601057 2023-02-09 06:03:21,057 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c2d95ec7372588b093dc8c22580052d5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,057 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3438d437007cb2564d43ef73a69ef32a, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing fa0bd967cfa5ceaa07640c9b2c7c5d58, disabling compactions & flushes 2023-02-09 06:03:21,062 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. after waiting 0 ms 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,062 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,062 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Waiting for close lock at 1675922601062Disabling compacts and flushes for region at 1675922601062Disabling writes for close at 1675922601062Writing region close event to WAL at 1675922601062Closed at 1675922601062 2023-02-09 06:03:21,063 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b314c96f311aedb0be128dda80a1d5b, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c2d95ec7372588b093dc8c22580052d5, disabling compactions & flushes 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3438d437007cb2564d43ef73a69ef32a, disabling compactions & flushes 2023-02-09 06:03:21,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. after waiting 0 ms 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. after waiting 0 ms 2023-02-09 06:03:21,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c2d95ec7372588b093dc8c22580052d5: Waiting for close lock at 1675922601068Disabling compacts and flushes for region at 1675922601068Disabling writes for close at 1675922601068Writing region close event to WAL at 1675922601068Closed at 1675922601068 2023-02-09 06:03:21,069 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,069 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3438d437007cb2564d43ef73a69ef32a: Waiting for close lock at 1675922601068Disabling compacts and flushes for region at 1675922601068Disabling writes for close at 1675922601068Writing region close event to WAL at 1675922601069 (+1 ms)Closed at 1675922601069 2023-02-09 06:03:21,069 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8d5c41d9f4ef726643d2645b4e448768, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp 2023-02-09 06:03:21,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 7b314c96f311aedb0be128dda80a1d5b, disabling compactions & flushes 2023-02-09 06:03:21,076 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. after waiting 0 ms 2023-02-09 06:03:21,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,076 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,077 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 7b314c96f311aedb0be128dda80a1d5b: Waiting for close lock at 1675922601076Disabling compacts and flushes for region at 1675922601076Disabling writes for close at 1675922601076Writing region close event to WAL at 1675922601076Closed at 1675922601076 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 8d5c41d9f4ef726643d2645b4e448768, disabling compactions & flushes 2023-02-09 06:03:21,078 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. after waiting 0 ms 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,078 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 8d5c41d9f4ef726643d2645b4e448768: Waiting for close lock at 1675922601078Disabling compacts and flushes for region at 1675922601078Disabling writes for close at 1675922601078Writing region close event to WAL at 1675922601078Closed at 1675922601078 2023-02-09 06:03:21,080 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,082 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,082 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922601081"}]},"ts":"1675922601081"} 2023-02-09 06:03:21,084 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 06:03:21,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:21,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922601084"}]},"ts":"1675922601084"} 2023-02-09 06:03:21,085 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-09 06:03:21,089 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:21,095 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:21,095 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:21,095 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:21,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, ASSIGN}] 2023-02-09 06:03:21,098 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, ASSIGN 2023-02-09 06:03:21,098 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, ASSIGN 2023-02-09 06:03:21,098 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, ASSIGN 2023-02-09 06:03:21,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, ASSIGN 2023-02-09 06:03:21,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38605,1675922599841; forceNewPlan=false, retain=false 2023-02-09 06:03:21,098 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:21,099 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38605,1675922599841; forceNewPlan=false, retain=false 2023-02-09 06:03:21,098 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:21,099 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, ASSIGN 2023-02-09 06:03:21,099 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, ASSIGN 2023-02-09 06:03:21,099 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, ASSIGN 2023-02-09 06:03:21,099 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, ASSIGN 2023-02-09 06:03:21,100 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, ASSIGN 2023-02-09 06:03:21,100 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38605,1675922599841; forceNewPlan=false, retain=false 2023-02-09 06:03:21,100 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38605,1675922599841; forceNewPlan=false, retain=false 2023-02-09 06:03:21,100 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:21,100 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38605,1675922599841; forceNewPlan=false, retain=false 2023-02-09 06:03:21,100 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:21,101 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, ASSIGN 2023-02-09 06:03:21,102 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40129,1675922599871; forceNewPlan=false, retain=false 2023-02-09 06:03:21,113 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,113 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:21,181 INFO [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38605%2C1675922599841, suffix=, logDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,38605,1675922599841, archiveDir=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs, maxLogs=32 2023-02-09 06:03:21,194 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK] 2023-02-09 06:03:21,194 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK] 2023-02-09 06:03:21,197 INFO [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/WALs/jenkins-hbase4.apache.org,38605,1675922599841/jenkins-hbase4.apache.org%2C38605%2C1675922599841.1675922601181 2023-02-09 06:03:21,197 DEBUG [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36469,DS-ef2c30f4-7536-460c-bad3-dfa453c85ee7,DISK], DatanodeInfoWithStorage[127.0.0.1:40979,DS-031131a5-0f88-4f5b-9b5b-e04eae6f410c,DISK]] 2023-02-09 06:03:21,249 INFO [jenkins-hbase4:37713] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 06:03:21,255 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7b314c96f311aedb0be128dda80a1d5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,255 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ec44993d0312f7a01556e63b6334fcd4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,255 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601255"}]},"ts":"1675922601255"} 2023-02-09 06:03:21,255 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c2d95ec7372588b093dc8c22580052d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3de757b31d243ac95ceb60a256604797, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,255 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=31bb9d0f03ebdf7f0614444194a0bf1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601255"}]},"ts":"1675922601255"} 2023-02-09 06:03:21,255 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601255"}]},"ts":"1675922601255"} 2023-02-09 06:03:21,255 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601255"}]},"ts":"1675922601255"} 2023-02-09 06:03:21,255 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601255"}]},"ts":"1675922601255"} 2023-02-09 06:03:21,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 7b314c96f311aedb0be128dda80a1d5b, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:21,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 3de757b31d243ac95ceb60a256604797, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:21,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure c2d95ec7372588b093dc8c22580052d5, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:21,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure ec44993d0312f7a01556e63b6334fcd4, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:21,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 31bb9d0f03ebdf7f0614444194a0bf1f, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:21,260 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e717b28edc8d329a2814bd2f962e04b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,260 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601260"}]},"ts":"1675922601260"} 2023-02-09 06:03:21,261 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e4f9d9f31d365985d839e60788163871, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,261 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601261"}]},"ts":"1675922601261"} 2023-02-09 06:03:21,261 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8d5c41d9f4ef726643d2645b4e448768, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,261 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601261"}]},"ts":"1675922601261"} 2023-02-09 06:03:21,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=14, state=RUNNABLE; OpenRegionProcedure e717b28edc8d329a2814bd2f962e04b8, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:21,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa0bd967cfa5ceaa07640c9b2c7c5d58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601262"}]},"ts":"1675922601262"} 2023-02-09 06:03:21,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure e4f9d9f31d365985d839e60788163871, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:21,263 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3438d437007cb2564d43ef73a69ef32a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,263 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922601263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922601263"}]},"ts":"1675922601263"} 2023-02-09 06:03:21,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure 8d5c41d9f4ef726643d2645b4e448768, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:21,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure fa0bd967cfa5ceaa07640c9b2c7c5d58, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:21,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 3438d437007cb2564d43ef73a69ef32a, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:21,314 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,314 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:21,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b314c96f311aedb0be128dda80a1d5b, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 06:03:21,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,414 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,415 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1 2023-02-09 06:03:21,415 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1 2023-02-09 06:03:21,416 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b314c96f311aedb0be128dda80a1d5b columnFamilyName f1 2023-02-09 06:03:21,416 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(310): Store=7b314c96f311aedb0be128dda80a1d5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,416 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3438d437007cb2564d43ef73a69ef32a, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 06:03:21,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,417 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2 2023-02-09 06:03:21,417 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2 2023-02-09 06:03:21,418 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b314c96f311aedb0be128dda80a1d5b columnFamilyName f2 2023-02-09 06:03:21,418 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,418 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(310): Store=7b314c96f311aedb0be128dda80a1d5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,419 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1 2023-02-09 06:03:21,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,419 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1 2023-02-09 06:03:21,419 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3438d437007cb2564d43ef73a69ef32a columnFamilyName f1 2023-02-09 06:03:21,420 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(310): Store=3438d437007cb2564d43ef73a69ef32a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,420 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,421 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2 2023-02-09 06:03:21,421 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2 2023-02-09 06:03:21,421 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3438d437007cb2564d43ef73a69ef32a columnFamilyName f2 2023-02-09 06:03:21,422 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(310): Store=3438d437007cb2564d43ef73a69ef32a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:21,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7b314c96f311aedb0be128dda80a1d5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68257502, jitterRate=0.017116039991378784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7b314c96f311aedb0be128dda80a1d5b: Running coprocessor pre-open hook at 1675922601413Writing region info on filesystem at 1675922601413Initializing all the Stores at 1675922601414 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601414Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601414Cleaning up temporary data from old regions at 1675922601420 (+6 ms)Cleaning up detritus from prior splits at 1675922601420Running coprocessor post-open hooks at 1675922601424 (+4 ms)Region opened successfully at 1675922601424 2023-02-09 06:03:21,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b., pid=21, masterSystemTime=1675922601409 2023-02-09 06:03:21,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:21,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec44993d0312f7a01556e63b6334fcd4, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 06:03:21,427 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7b314c96f311aedb0be128dda80a1d5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,427 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601427"}]},"ts":"1675922601427"} 2023-02-09 06:03:21,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3438d437007cb2564d43ef73a69ef32a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68815411, jitterRate=0.025429531931877136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3438d437007cb2564d43ef73a69ef32a: Running coprocessor pre-open hook at 1675922601417Writing region info on filesystem at 1675922601417Initializing all the Stores at 1675922601418 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601418Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601418Cleaning up temporary data from old regions at 1675922601424 (+6 ms)Cleaning up detritus from prior splits at 1675922601424Running coprocessor post-open hooks at 1675922601429 (+5 ms)Region opened successfully at 1675922601429 2023-02-09 06:03:21,429 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,430 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1 2023-02-09 06:03:21,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a., pid=30, masterSystemTime=1675922601414 2023-02-09 06:03:21,430 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1 2023-02-09 06:03:21,431 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec44993d0312f7a01556e63b6334fcd4 columnFamilyName f1 2023-02-09 06:03:21,431 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(310): Store=ec44993d0312f7a01556e63b6334fcd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,431 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-09 06:03:21,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 7b314c96f311aedb0be128dda80a1d5b, server=jenkins-hbase4.apache.org,40129,1675922599871 in 172 msec 2023-02-09 06:03:21,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:21,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fa0bd967cfa5ceaa07640c9b2c7c5d58, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 06:03:21,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3438d437007cb2564d43ef73a69ef32a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601432"}]},"ts":"1675922601432"} 2023-02-09 06:03:21,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,433 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2 2023-02-09 06:03:21,433 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2 2023-02-09 06:03:21,433 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec44993d0312f7a01556e63b6334fcd4 columnFamilyName f2 2023-02-09 06:03:21,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, ASSIGN in 337 msec 2023-02-09 06:03:21,434 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,434 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(310): Store=ec44993d0312f7a01556e63b6334fcd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,435 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1 2023-02-09 06:03:21,435 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1 2023-02-09 06:03:21,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-09 06:03:21,436 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa0bd967cfa5ceaa07640c9b2c7c5d58 columnFamilyName f1 2023-02-09 06:03:21,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 3438d437007cb2564d43ef73a69ef32a, server=jenkins-hbase4.apache.org,38605,1675922599841 in 169 msec 2023-02-09 06:03:21,436 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(310): Store=fa0bd967cfa5ceaa07640c9b2c7c5d58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,436 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, ASSIGN in 341 msec 2023-02-09 06:03:21,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,437 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2 2023-02-09 06:03:21,437 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2 2023-02-09 06:03:21,438 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa0bd967cfa5ceaa07640c9b2c7c5d58 columnFamilyName f2 2023-02-09 06:03:21,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:21,438 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(310): Store=fa0bd967cfa5ceaa07640c9b2c7c5d58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ec44993d0312f7a01556e63b6334fcd4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62666864, jitterRate=-0.06619095802307129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ec44993d0312f7a01556e63b6334fcd4: Running coprocessor pre-open hook at 1675922601428Writing region info on filesystem at 1675922601428Initializing all the Stores at 1675922601429 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601429Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601429Cleaning up temporary data from old regions at 1675922601436 (+7 ms)Cleaning up detritus from prior splits at 1675922601436Running coprocessor post-open hooks at 1675922601440 (+4 ms)Region opened successfully at 1675922601440 2023-02-09 06:03:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4., pid=24, masterSystemTime=1675922601409 2023-02-09 06:03:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c2d95ec7372588b093dc8c22580052d5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 06:03:21,443 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ec44993d0312f7a01556e63b6334fcd4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,443 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601443"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601443"}]},"ts":"1675922601443"} 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fa0bd967cfa5ceaa07640c9b2c7c5d58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61705354, jitterRate=-0.08051857352256775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Running coprocessor pre-open hook at 1675922601433Writing region info on filesystem at 1675922601433Initializing all the Stores at 1675922601433Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601433Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601434 (+1 ms)Cleaning up temporary data from old regions at 1675922601440 (+6 ms)Cleaning up detritus from prior splits at 1675922601440Running coprocessor post-open hooks at 1675922601444 (+4 ms)Region opened successfully at 1675922601444 2023-02-09 06:03:21,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58., pid=29, masterSystemTime=1675922601414 2023-02-09 06:03:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8d5c41d9f4ef726643d2645b4e448768, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 06:03:21,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa0bd967cfa5ceaa07640c9b2c7c5d58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601446"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601446"}]},"ts":"1675922601446"} 2023-02-09 06:03:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-09 06:03:21,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure ec44993d0312f7a01556e63b6334fcd4, server=jenkins-hbase4.apache.org,40129,1675922599871 in 187 msec 2023-02-09 06:03:21,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, ASSIGN in 353 msec 2023-02-09 06:03:21,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-09 06:03:21,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure fa0bd967cfa5ceaa07640c9b2c7c5d58, server=jenkins-hbase4.apache.org,38605,1675922599841 in 184 msec 2023-02-09 06:03:21,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, ASSIGN in 355 msec 2023-02-09 06:03:21,452 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,455 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,455 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1 2023-02-09 06:03:21,456 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1 2023-02-09 06:03:21,456 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d95ec7372588b093dc8c22580052d5 columnFamilyName f1 2023-02-09 06:03:21,456 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f1 2023-02-09 06:03:21,456 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f1 2023-02-09 06:03:21,456 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d5c41d9f4ef726643d2645b4e448768 columnFamilyName f1 2023-02-09 06:03:21,456 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(310): Store=c2d95ec7372588b093dc8c22580052d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,457 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,457 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(310): Store=8d5c41d9f4ef726643d2645b4e448768/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,457 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,458 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2 2023-02-09 06:03:21,458 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2 2023-02-09 06:03:21,458 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f2 2023-02-09 06:03:21,458 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f2 2023-02-09 06:03:21,458 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d95ec7372588b093dc8c22580052d5 columnFamilyName f2 2023-02-09 06:03:21,459 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d5c41d9f4ef726643d2645b4e448768 columnFamilyName f2 2023-02-09 06:03:21,459 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(310): Store=c2d95ec7372588b093dc8c22580052d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,459 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(310): Store=8d5c41d9f4ef726643d2645b4e448768/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:21,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:21,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c2d95ec7372588b093dc8c22580052d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60388341, jitterRate=-0.10014359652996063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8d5c41d9f4ef726643d2645b4e448768; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69264921, jitterRate=0.032127752900123596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c2d95ec7372588b093dc8c22580052d5: Running coprocessor pre-open hook at 1675922601443Writing region info on filesystem at 1675922601443Initializing all the Stores at 1675922601444 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601444Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601452 (+8 ms)Cleaning up temporary data from old regions at 1675922601460 (+8 ms)Cleaning up detritus from prior splits at 1675922601461 (+1 ms)Running coprocessor post-open hooks at 1675922601465 (+4 ms)Region opened successfully at 1675922601465 2023-02-09 06:03:21,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8d5c41d9f4ef726643d2645b4e448768: Running coprocessor pre-open hook at 1675922601447Writing region info on filesystem at 1675922601447Initializing all the Stores at 1675922601448 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601448Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601455 (+7 ms)Cleaning up temporary data from old regions at 1675922601461 (+6 ms)Cleaning up detritus from prior splits at 1675922601461Running coprocessor post-open hooks at 1675922601465 (+4 ms)Region opened successfully at 1675922601465 2023-02-09 06:03:21,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5., pid=23, masterSystemTime=1675922601409 2023-02-09 06:03:21,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:21,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3de757b31d243ac95ceb60a256604797, NAME => 'testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 06:03:21,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c2d95ec7372588b093dc8c22580052d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768., pid=28, masterSystemTime=1675922601414 2023-02-09 06:03:21,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601467"}]},"ts":"1675922601467"} 2023-02-09 06:03:21,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,469 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,471 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f1 2023-02-09 06:03:21,471 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f1 2023-02-09 06:03:21,471 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3de757b31d243ac95ceb60a256604797 columnFamilyName f1 2023-02-09 06:03:21,472 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(310): Store=3de757b31d243ac95ceb60a256604797/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,473 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4f9d9f31d365985d839e60788163871, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 06:03:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,474 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f2 2023-02-09 06:03:21,474 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f2 2023-02-09 06:03:21,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8d5c41d9f4ef726643d2645b4e448768, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,475 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3de757b31d243ac95ceb60a256604797 columnFamilyName f2 2023-02-09 06:03:21,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601474"}]},"ts":"1675922601474"} 2023-02-09 06:03:21,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-09 06:03:21,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure c2d95ec7372588b093dc8c22580052d5, server=jenkins-hbase4.apache.org,40129,1675922599871 in 211 msec 2023-02-09 06:03:21,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, ASSIGN in 380 msec 2023-02-09 06:03:21,476 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(310): Store=3de757b31d243ac95ceb60a256604797/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,476 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,478 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1 2023-02-09 06:03:21,478 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1 2023-02-09 06:03:21,478 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f9d9f31d365985d839e60788163871 columnFamilyName f1 2023-02-09 06:03:21,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-09 06:03:21,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure 8d5c41d9f4ef726643d2645b4e448768, server=jenkins-hbase4.apache.org,38605,1675922599841 in 212 msec 2023-02-09 06:03:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,479 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(310): Store=e4f9d9f31d365985d839e60788163871/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, ASSIGN in 384 msec 2023-02-09 06:03:21,480 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:21,481 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2 2023-02-09 06:03:21,481 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2 2023-02-09 06:03:21,481 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f9d9f31d365985d839e60788163871 columnFamilyName f2 2023-02-09 06:03:21,482 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(310): Store=e4f9d9f31d365985d839e60788163871/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3de757b31d243ac95ceb60a256604797; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60295112, jitterRate=-0.10153281688690186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3de757b31d243ac95ceb60a256604797: Running coprocessor pre-open hook at 1675922601468Writing region info on filesystem at 1675922601468Initializing all the Stores at 1675922601469 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601469Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601469Cleaning up temporary data from old regions at 1675922601478 (+9 ms)Cleaning up detritus from prior splits at 1675922601478Running coprocessor post-open hooks at 1675922601483 (+5 ms)Region opened successfully at 1675922601483 2023-02-09 06:03:21,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797., pid=22, masterSystemTime=1675922601409 2023-02-09 06:03:21,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31bb9d0f03ebdf7f0614444194a0bf1f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 06:03:21,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3de757b31d243ac95ceb60a256604797, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922601485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601485"}]},"ts":"1675922601485"} 2023-02-09 06:03:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:21,487 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e4f9d9f31d365985d839e60788163871; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68472341, jitterRate=0.02031739056110382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e4f9d9f31d365985d839e60788163871: Running coprocessor pre-open hook at 1675922601474Writing region info on filesystem at 1675922601474Initializing all the Stores at 1675922601476 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601476Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601476Cleaning up temporary data from old regions at 1675922601483 (+7 ms)Cleaning up detritus from prior splits at 1675922601484 (+1 ms)Running coprocessor post-open hooks at 1675922601489 (+5 ms)Region opened successfully at 1675922601489 2023-02-09 06:03:21,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-09 06:03:21,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 3de757b31d243ac95ceb60a256604797, server=jenkins-hbase4.apache.org,40129,1675922599871 in 230 msec 2023-02-09 06:03:21,489 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1 2023-02-09 06:03:21,489 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1 2023-02-09 06:03:21,489 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31bb9d0f03ebdf7f0614444194a0bf1f columnFamilyName f1 2023-02-09 06:03:21,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871., pid=27, masterSystemTime=1675922601414 2023-02-09 06:03:21,490 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(310): Store=31bb9d0f03ebdf7f0614444194a0bf1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,490 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, ASSIGN in 394 msec 2023-02-09 06:03:21,491 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2 2023-02-09 06:03:21,492 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2 2023-02-09 06:03:21,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,492 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31bb9d0f03ebdf7f0614444194a0bf1f columnFamilyName f2 2023-02-09 06:03:21,492 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e4f9d9f31d365985d839e60788163871, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e717b28edc8d329a2814bd2f962e04b8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 06:03:21,493 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601492"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601492"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601492"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601492"}]},"ts":"1675922601492"} 2023-02-09 06:03:21,493 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(310): Store=31bb9d0f03ebdf7f0614444194a0bf1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:21,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,494 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,496 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1 2023-02-09 06:03:21,496 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1 2023-02-09 06:03:21,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-09 06:03:21,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure e4f9d9f31d365985d839e60788163871, server=jenkins-hbase4.apache.org,38605,1675922599841 in 232 msec 2023-02-09 06:03:21,497 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e717b28edc8d329a2814bd2f962e04b8 columnFamilyName f1 2023-02-09 06:03:21,497 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(310): Store=e717b28edc8d329a2814bd2f962e04b8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,497 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, ASSIGN in 402 msec 2023-02-09 06:03:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:21,499 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2 2023-02-09 06:03:21,499 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2 2023-02-09 06:03:21,499 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e717b28edc8d329a2814bd2f962e04b8 columnFamilyName f2 2023-02-09 06:03:21,500 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(310): Store=e717b28edc8d329a2814bd2f962e04b8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:21,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31bb9d0f03ebdf7f0614444194a0bf1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61294491, jitterRate=-0.08664090931415558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Running coprocessor pre-open hook at 1675922601486Writing region info on filesystem at 1675922601486Initializing all the Stores at 1675922601487 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601487Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601487Cleaning up temporary data from old regions at 1675922601496 (+9 ms)Cleaning up detritus from prior splits at 1675922601496Running coprocessor post-open hooks at 1675922601502 (+6 ms)Region opened successfully at 1675922601502 2023-02-09 06:03:21,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f., pid=25, masterSystemTime=1675922601409 2023-02-09 06:03:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:21,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=31bb9d0f03ebdf7f0614444194a0bf1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,505 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601505"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601505"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601505"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601505"}]},"ts":"1675922601505"} 2023-02-09 06:03:21,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:21,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e717b28edc8d329a2814bd2f962e04b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70738013, jitterRate=0.05407853424549103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:21,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e717b28edc8d329a2814bd2f962e04b8: Running coprocessor pre-open hook at 1675922601493Writing region info on filesystem at 1675922601493Initializing all the Stores at 1675922601494 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601494Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922601494Cleaning up temporary data from old regions at 1675922601502 (+8 ms)Cleaning up detritus from prior splits at 1675922601503 (+1 ms)Running coprocessor post-open hooks at 1675922601507 (+4 ms)Region opened successfully at 1675922601507 2023-02-09 06:03:21,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8., pid=26, masterSystemTime=1675922601414 2023-02-09 06:03:21,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-09 06:03:21,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 31bb9d0f03ebdf7f0614444194a0bf1f, server=jenkins-hbase4.apache.org,40129,1675922599871 in 246 msec 2023-02-09 06:03:21,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, ASSIGN in 413 msec 2023-02-09 06:03:21,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e717b28edc8d329a2814bd2f962e04b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922601510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922601510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922601510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922601510"}]},"ts":"1675922601510"} 2023-02-09 06:03:21,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=14 2023-02-09 06:03:21,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=14, state=SUCCESS; OpenRegionProcedure e717b28edc8d329a2814bd2f962e04b8, server=jenkins-hbase4.apache.org,38605,1675922599841 in 249 msec 2023-02-09 06:03:21,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-09 06:03:21,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, ASSIGN in 417 msec 2023-02-09 06:03:21,514 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:21,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922601514"}]},"ts":"1675922601514"} 2023-02-09 06:03:21,516 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-09 06:03:21,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:21,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 510 msec 2023-02-09 06:03:21,617 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,617 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:21,618 INFO [Listener at localhost/34763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-09 06:03:21,618 DEBUG [Listener at localhost/34763] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-09 06:03:21,619 INFO [Listener at localhost/34763] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:21,622 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-09 06:03:21,622 INFO [Listener at localhost/34763] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:21,622 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-09 06:03:21,622 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:21,656 DEBUG [hconnection-0x75edd87-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:21,669 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:21,678 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38605] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,678 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40129] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,749 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:21,749 INFO [Listener at localhost/34763] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:21,750 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,750 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 06:03:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922601751 (current time:1675922601751). 2023-02-09 06:03:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:21,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] zookeeper.ReadOnlyZKClient(139): Connect 0x4af0f748 to 127.0.0.1:62943 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:21,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698c1abc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:21,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:21,761 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af0f748 to 127.0.0.1:62943 2023-02-09 06:03:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 06:03:21,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 06:03:21,766 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 06:03:21,767 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675923201767 2023-02-09 06:03:21,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 06:03:21,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,769 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:21,769 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:21,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 06:03:21,770 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 06:03:21,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-09 06:03:21,772 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 06:03:21,772 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675923201772 2023-02-09 06:03:21,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,786 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 06:03:21,786 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:21,786 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 06:03:21,787 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 06:03:21,791 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 06:03:21,865 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,865 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,867 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:21,867 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:21,867 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:21,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:21,868 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,868 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,868 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,868 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:21,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,869 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:21,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,869 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 06:03:21,869 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:21,869 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40129,1675922599871' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 06:03:21,871 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:21,871 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38605,1675922599841' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 06:03:21,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:21,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:21,873 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,873 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,873 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:21,874 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,874 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:21,874 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:21,874 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:21,874 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,874 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:21,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40129,1675922599871' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 06:03:21,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@446f5ea1[Count = 1] remaining members to acquire global barrier 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:21,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38605,1675922599841' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 06:03:21,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@446f5ea1[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:21,877 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 06:03:21,877 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,878 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:21,879 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,879 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:21,879 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:03:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. started... 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. started... 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. started... 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:21,879 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. started... 2023-02-09 06:03:21,880 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. started... 2023-02-09 06:03:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 06:03:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:21,884 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8d5c41d9f4ef726643d2645b4e448768: 2023-02-09 06:03:21,885 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7b314c96f311aedb0be128dda80a1d5b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:03:21,885 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 31bb9d0f03ebdf7f0614444194a0bf1f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:21,885 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fa0bd967cfa5ceaa07640c9b2c7c5d58 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:21,884 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3de757b31d243ac95ceb60a256604797: 2023-02-09 06:03:21,884 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:21,885 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. started... 2023-02-09 06:03:21,885 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,885 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,887 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:21,888 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:21,888 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:21,888 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:21,886 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e4f9d9f31d365985d839e60788163871 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 06:03:21,888 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:21,888 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 06:03:21,908 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. completed. 2023-02-09 06:03:21,908 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:21,908 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:21,908 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:03:21,908 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. started... 2023-02-09 06:03:21,909 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e717b28edc8d329a2814bd2f962e04b8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:21,912 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. completed. 2023-02-09 06:03:21,913 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:21,913 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 06:03:21,913 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. started... 2023-02-09 06:03:21,923 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f1/4dc0cb34662f41f79662f255f669bdd8 2023-02-09 06:03:21,924 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f1/2e8a3cc9664b47579e1c38de21cd1578 2023-02-09 06:03:21,925 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ec44993d0312f7a01556e63b6334fcd4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:21,929 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f1/365917bde9c54126a59f4a7fe888a5ed 2023-02-09 06:03:21,941 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f1/90d39226463a4591babe0279dead3b49 2023-02-09 06:03:21,954 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f1/3e06b4a6147040cf9257cb574a500f7b 2023-02-09 06:03:21,976 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f2/1add4e0877a04ea081a379153b5e3c7d 2023-02-09 06:03:21,981 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f1/2e8a3cc9664b47579e1c38de21cd1578 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578 2023-02-09 06:03:21,986 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:21,987 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f2/1add4e0877a04ea081a379153b5e3c7d as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d 2023-02-09 06:03:21,992 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f2/96ee3861a353469793582e2117857d25 2023-02-09 06:03:21,993 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:21,995 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fa0bd967cfa5ceaa07640c9b2c7c5d58 in 111ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:21,995 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578] hfiles 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d] hfiles 2023-02-09 06:03:21,996 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,002 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f2/68dfb3928bae4ac9984aadf3833ef068 2023-02-09 06:03:22,005 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f2/a7883269936049eea7d2617ef6d0d9bb 2023-02-09 06:03:22,006 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f1/4dc0cb34662f41f79662f255f669bdd8 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8 2023-02-09 06:03:22,009 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f1/90d39226463a4591babe0279dead3b49 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49 2023-02-09 06:03:22,011 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:22,012 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f2/96ee3861a353469793582e2117857d25 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25 2023-02-09 06:03:22,016 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. completed. 2023-02-09 06:03:22,016 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:22,016 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:03:22,016 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. started... 2023-02-09 06:03:22,018 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:22,018 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f1/3e06b4a6147040cf9257cb574a500f7b as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b 2023-02-09 06:03:22,019 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f2/68dfb3928bae4ac9984aadf3833ef068 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068 2023-02-09 06:03:22,023 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,023 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f2/a7883269936049eea7d2617ef6d0d9bb as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb 2023-02-09 06:03:22,025 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:22,025 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7b314c96f311aedb0be128dda80a1d5b in 140ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,028 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7b314c96f311aedb0be128dda80a1d5b: 2023-02-09 06:03:22,029 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3438d437007cb2564d43ef73a69ef32a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8] hfiles 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25] hfiles 2023-02-09 06:03:22,029 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,030 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e717b28edc8d329a2814bd2f962e04b8 in 121ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e717b28edc8d329a2814bd2f962e04b8: 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b] hfiles 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb] hfiles 2023-02-09 06:03:22,030 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,031 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 06:03:22,032 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e4f9d9f31d365985d839e60788163871 in 146ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,032 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e4f9d9f31d365985d839e60788163871: 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49] hfiles 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068] hfiles 2023-02-09 06:03:22,033 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,071 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f1/5ad503b39d5a45cd93e871b8d6888fc9 2023-02-09 06:03:22,072 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. completed. 2023-02-09 06:03:22,072 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:22,072 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:03:22,073 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:22,073 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:22,073 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:22,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:22,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:22,075 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 06:03:22,076 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. completed. 2023-02-09 06:03:22,076 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:22,076 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:03:22,090 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f2/02175d6814ea40f8a8a756fafe542261 2023-02-09 06:03:22,095 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f1/5ad503b39d5a45cd93e871b8d6888fc9 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9 2023-02-09 06:03:22,099 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,099 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f2/02175d6814ea40f8a8a756fafe542261 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261 2023-02-09 06:03:22,104 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,104 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3438d437007cb2564d43ef73a69ef32a in 75ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,104 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3438d437007cb2564d43ef73a69ef32a: 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9] hfiles 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261] hfiles 2023-02-09 06:03:22,105 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,110 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. completed. 2023-02-09 06:03:22,110 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:22,111 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:03:22,111 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:03:22,111 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,111 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 06:03:22,111 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38605,1675922599841' in zk 2023-02-09 06:03:22,113 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:03:22,113 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,113 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:22,113 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 06:03:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38605,1675922599841': 2023-02-09 06:03:22,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38605,1675922599841' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 06:03:22,373 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f2/70b5adc8a3e24ee5b6fd618d56b304ae 2023-02-09 06:03:22,375 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:22,375 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:22,375 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:22,376 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 2023-02-09 06:03:22,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:22,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:22,377 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 06:03:22,378 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f1/365917bde9c54126a59f4a7fe888a5ed as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed 2023-02-09 06:03:22,383 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,383 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f2/70b5adc8a3e24ee5b6fd618d56b304ae as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae 2023-02-09 06:03:22,387 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,388 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 31bb9d0f03ebdf7f0614444194a0bf1f in 504ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,388 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 31bb9d0f03ebdf7f0614444194a0bf1f: 2023-02-09 06:03:22,388 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,389 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,389 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed] hfiles 2023-02-09 06:03:22,389 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,389 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae] hfiles 2023-02-09 06:03:22,389 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,395 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. completed. 2023-02-09 06:03:22,395 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:22,395 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:22,395 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 06:03:22,395 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. started... 2023-02-09 06:03:22,396 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c2d95ec7372588b093dc8c22580052d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 06:03:22,397 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f2/eff15cd284c442ae8205e261af330e1a 2023-02-09 06:03:22,404 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 2023-02-09 06:03:22,408 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,409 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f2/eff15cd284c442ae8205e261af330e1a as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a 2023-02-09 06:03:22,414 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,415 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ec44993d0312f7a01556e63b6334fcd4 in 490ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,415 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ec44993d0312f7a01556e63b6334fcd4: 2023-02-09 06:03:22,415 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,416 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,416 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6] hfiles 2023-02-09 06:03:22,416 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,416 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a] hfiles 2023-02-09 06:03:22,416 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,416 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f1/09a51d77ca7d4908994f10f278ba6928 2023-02-09 06:03:22,422 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. completed. 2023-02-09 06:03:22,422 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:22,422 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 06:03:22,430 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f2/346acefbfbdd4fee9d12971fc14c5b4f 2023-02-09 06:03:22,434 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f1/09a51d77ca7d4908994f10f278ba6928 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928 2023-02-09 06:03:22,438 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,438 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f2/346acefbfbdd4fee9d12971fc14c5b4f as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f 2023-02-09 06:03:22,442 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 06:03:22,443 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c2d95ec7372588b093dc8c22580052d5 in 47ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:22,443 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c2d95ec7372588b093dc8c22580052d5: 2023-02-09 06:03:22,443 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,443 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:22,444 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928] hfiles 2023-02-09 06:03:22,444 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,444 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f] hfiles 2023-02-09 06:03:22,444 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,449 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. completed. 2023-02-09 06:03:22,449 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:22,449 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. completed. 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 06:03:22,449 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 06:03:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40129,1675922599871' in zk 2023-02-09 06:03:22,451 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,451 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:03:22,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,451 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:22,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:22,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:22,451 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 06:03:22,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:22,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:22,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40129,1675922599871': 2023-02-09 06:03:22,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40129,1675922599871' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:22,454 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 06:03:22,454 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:22,454 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:22,454 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,454 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:22,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:22,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:22,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:22,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:22,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:22,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:22,456 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,456 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,458 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:22,458 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,463 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:22,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:22,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,464 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:22,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:22,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:22,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:22,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:22,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:22,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-09 06:03:22,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,530 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675922601767Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675922602464 (+697 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675922602464Writing data manifest for testWithMockedMapReduceMultiRegion at 1675922602478 (+14 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675922602496 (+18 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675922602530 (+34 ms) 2023-02-09 06:03:22,532 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 06:03:22,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 763 msec 2023-02-09 06:03:22,877 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:22,877 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:22,877 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:22,879 INFO [Listener at localhost/34763] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:22,879 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:22,879 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:22,884 INFO [Listener at localhost/34763] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:22,890 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:22,922 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38605] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:22,922 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40129] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:22,980 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:22,984 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:22,984 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:22,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:22,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,989 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 06:03:22,989 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:22,990 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 06:03:22,990 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 06:03:22,990 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,990 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,992 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:22,992 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:22,992 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:22,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:22,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:22,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:22,992 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:22,993 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:22,993 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:22,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:22,994 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 06:03:22,994 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:22,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,000 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:03:23,001 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 06:03:23,001 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:23,001 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. started... 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. started... 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. started... 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8d5c41d9f4ef726643d2645b4e448768: 2023-02-09 06:03:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:03:23,002 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e4f9d9f31d365985d839e60788163871 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:03:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:23,002 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fa0bd967cfa5ceaa07640c9b2c7c5d58 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. started... 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. started... 2023-02-09 06:03:23,005 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 31bb9d0f03ebdf7f0614444194a0bf1f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,005 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3de757b31d243ac95ceb60a256604797: 2023-02-09 06:03:23,005 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,005 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,005 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. started... 2023-02-09 06:03:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:03:23,005 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec44993d0312f7a01556e63b6334fcd4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:23,005 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. started... 2023-02-09 06:03:23,006 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e717b28edc8d329a2814bd2f962e04b8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,002 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. started... 2023-02-09 06:03:23,006 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7b314c96f311aedb0be128dda80a1d5b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 06:03:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 06:03:23,006 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:23,006 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 06:03:23,040 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f1/6a3bd261747549d3a95650cf36504a80 2023-02-09 06:03:23,048 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f1/57199652bc5d4c3e93e6223fa986c7a5 2023-02-09 06:03:23,056 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f1/aafe9fedd3ad4b3384029832433ab1f7 2023-02-09 06:03:23,081 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f1/6a88e7876d53497aab44bb8318cfeb4b 2023-02-09 06:03:23,084 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f2/3c7aab24375f401aac381a8a205ccfbe 2023-02-09 06:03:23,085 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f1/460b0045c9744c309a3afe0cfa7fd95e 2023-02-09 06:03:23,092 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f1/6a3bd261747549d3a95650cf36504a80 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/6a3bd261747549d3a95650cf36504a80 2023-02-09 06:03:23,097 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/6a3bd261747549d3a95650cf36504a80, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,098 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/.tmp/f2/3c7aab24375f401aac381a8a205ccfbe as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/3c7aab24375f401aac381a8a205ccfbe 2023-02-09 06:03:23,103 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/3c7aab24375f401aac381a8a205ccfbe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,104 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fa0bd967cfa5ceaa07640c9b2c7c5d58 in 102ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,104 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: 2023-02-09 06:03:23,104 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:23,104 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:23,104 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. started... 2023-02-09 06:03:23,104 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3438d437007cb2564d43ef73a69ef32a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,124 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f2/5e04bb6175574178b42e84259de596b8 2023-02-09 06:03:23,128 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f2/963b96c5d6624cb3847a569ba967587a 2023-02-09 06:03:23,129 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f1/57199652bc5d4c3e93e6223fa986c7a5 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/57199652bc5d4c3e93e6223fa986c7a5 2023-02-09 06:03:23,133 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f1/aafe9fedd3ad4b3384029832433ab1f7 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/aafe9fedd3ad4b3384029832433ab1f7 2023-02-09 06:03:23,134 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/57199652bc5d4c3e93e6223fa986c7a5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:23,134 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/.tmp/f2/5e04bb6175574178b42e84259de596b8 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/5e04bb6175574178b42e84259de596b8 2023-02-09 06:03:23,137 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f2/feb16b9fd8784646a8afc0396cfeccdd 2023-02-09 06:03:23,138 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/aafe9fedd3ad4b3384029832433ab1f7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:23,139 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/.tmp/f2/963b96c5d6624cb3847a569ba967587a as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/963b96c5d6624cb3847a569ba967587a 2023-02-09 06:03:23,141 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/5e04bb6175574178b42e84259de596b8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:23,141 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e4f9d9f31d365985d839e60788163871 in 139ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,142 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e4f9d9f31d365985d839e60788163871: 2023-02-09 06:03:23,142 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,142 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:23,143 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f1/460b0045c9744c309a3afe0cfa7fd95e as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/460b0045c9744c309a3afe0cfa7fd95e 2023-02-09 06:03:23,144 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/963b96c5d6624cb3847a569ba967587a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 06:03:23,145 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7b314c96f311aedb0be128dda80a1d5b in 139ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,145 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f1/12ee5fbcf82c43038774bf8db56c5887 2023-02-09 06:03:23,145 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7b314c96f311aedb0be128dda80a1d5b: 2023-02-09 06:03:23,145 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,145 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,145 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 06:03:23,146 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. started... 2023-02-09 06:03:23,146 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c2d95ec7372588b093dc8c22580052d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 06:03:23,149 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f2/2a29398f71844cb299d471fb8351ec63 2023-02-09 06:03:23,152 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/460b0045c9744c309a3afe0cfa7fd95e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,153 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/.tmp/f2/feb16b9fd8784646a8afc0396cfeccdd as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/feb16b9fd8784646a8afc0396cfeccdd 2023-02-09 06:03:23,155 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f1/6a88e7876d53497aab44bb8318cfeb4b as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/6a88e7876d53497aab44bb8318cfeb4b 2023-02-09 06:03:23,158 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/feb16b9fd8784646a8afc0396cfeccdd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,159 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ec44993d0312f7a01556e63b6334fcd4 in 154ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,159 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec44993d0312f7a01556e63b6334fcd4: 2023-02-09 06:03:23,160 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,160 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 06:03:23,160 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/6a88e7876d53497aab44bb8318cfeb4b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,161 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/.tmp/f2/2a29398f71844cb299d471fb8351ec63 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/2a29398f71844cb299d471fb8351ec63 2023-02-09 06:03:23,168 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f1/f20f7f3246a64aeda07242c4e8ccc962 2023-02-09 06:03:23,171 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/2a29398f71844cb299d471fb8351ec63, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,172 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 31bb9d0f03ebdf7f0614444194a0bf1f in 166ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,172 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 31bb9d0f03ebdf7f0614444194a0bf1f: 2023-02-09 06:03:23,172 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,172 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:23,174 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f2/852323e1b47444dbb2a47b05167547b5 2023-02-09 06:03:23,179 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f1/12ee5fbcf82c43038774bf8db56c5887 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/12ee5fbcf82c43038774bf8db56c5887 2023-02-09 06:03:23,183 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f2/9d9766cf8df84ff4b63cb642d4e1c443 2023-02-09 06:03:23,183 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/12ee5fbcf82c43038774bf8db56c5887, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,184 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/.tmp/f2/852323e1b47444dbb2a47b05167547b5 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/852323e1b47444dbb2a47b05167547b5 2023-02-09 06:03:23,189 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/852323e1b47444dbb2a47b05167547b5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,189 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f1/f20f7f3246a64aeda07242c4e8ccc962 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/f20f7f3246a64aeda07242c4e8ccc962 2023-02-09 06:03:23,190 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3438d437007cb2564d43ef73a69ef32a in 86ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3438d437007cb2564d43ef73a69ef32a: 2023-02-09 06:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,190 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 06:03:23,193 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/f20f7f3246a64aeda07242c4e8ccc962, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,194 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/.tmp/f2/9d9766cf8df84ff4b63cb642d4e1c443 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/9d9766cf8df84ff4b63cb642d4e1c443 2023-02-09 06:03:23,199 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/9d9766cf8df84ff4b63cb642d4e1c443, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,200 INFO [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c2d95ec7372588b093dc8c22580052d5 in 54ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,200 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c2d95ec7372588b093dc8c22580052d5: 2023-02-09 06:03:23,200 DEBUG [rs(jenkins-hbase4.apache.org,40129,1675922599871)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,200 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:23,200 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:23,200 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,200 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 06:03:23,200 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40129,1675922599871' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 06:03:23,202 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,202 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:23,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:23,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:23,203 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,203 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:23,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:23,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:23,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40129,1675922599871' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 06:03:23,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4050c2f4[Count = 1] remaining members to acquire global barrier 2023-02-09 06:03:23,476 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f1/d575014d47b24cfa998b345a8bfdce8f 2023-02-09 06:03:23,491 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f2/0f1b789e98474cb193427910d5e41da7 2023-02-09 06:03:23,496 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f1/d575014d47b24cfa998b345a8bfdce8f as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/d575014d47b24cfa998b345a8bfdce8f 2023-02-09 06:03:23,501 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/d575014d47b24cfa998b345a8bfdce8f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,502 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/.tmp/f2/0f1b789e98474cb193427910d5e41da7 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/0f1b789e98474cb193427910d5e41da7 2023-02-09 06:03:23,506 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/0f1b789e98474cb193427910d5e41da7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 06:03:23,507 INFO [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e717b28edc8d329a2814bd2f962e04b8 in 502ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:23,507 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e717b28edc8d329a2814bd2f962e04b8: 2023-02-09 06:03:23,507 DEBUG [rs(jenkins-hbase4.apache.org,38605,1675922599841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:23,507 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 06:03:23,507 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 06:03:23,507 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,507 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 06:03:23,507 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38605,1675922599841' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 06:03:23,509 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:23,510 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,510 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:23,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38605,1675922599841' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 06:03:23,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4050c2f4[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:23,511 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 06:03:23,512 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 06:03:23,513 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40129,1675922599871' in zk 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 06:03:23,513 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38605,1675922599841' in zk 2023-02-09 06:03:23,514 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,514 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:03:23,515 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,40129,1675922599871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 06:03:23,516 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,516 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 06:03:23,516 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:23,516 DEBUG [member: 'jenkins-hbase4.apache.org,38605,1675922599841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 06:03:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40129,1675922599871': 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40129,1675922599871' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38605,1675922599841': 2023-02-09 06:03:23,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38605,1675922599841' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:23,522 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 06:03:23,522 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:23,522 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:23,522 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,522 INFO [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:23,523 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,523 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,523 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,524 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:23,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:23,523 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,524 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:23,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:23,524 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,526 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,526 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:23,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:23,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-09 06:03:23,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:23,529 DEBUG [(jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:23,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:23,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:23,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:23,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:23,530 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,529 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:23,530 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:23,530 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,530 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,630 DEBUG [Listener at localhost/34763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:23,630 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:23,630 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:23,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:23,636 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675922601751 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:23,637 DEBUG [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(239): region to add: 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=3de757b31d243ac95ceb60a256604797 as 3de757b31d243ac95ceb60a256604797 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,637 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=31bb9d0f03ebdf7f0614444194a0bf1f as 31bb9d0f03ebdf7f0614444194a0bf1f in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=fa0bd967cfa5ceaa07640c9b2c7c5d58 as fa0bd967cfa5ceaa07640c9b2c7c5d58 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=7b314c96f311aedb0be128dda80a1d5b as 7b314c96f311aedb0be128dda80a1d5b in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=8d5c41d9f4ef726643d2645b4e448768 as 8d5c41d9f4ef726643d2645b4e448768 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=e4f9d9f31d365985d839e60788163871 as e4f9d9f31d365985d839e60788163871 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=e717b28edc8d329a2814bd2f962e04b8 as e717b28edc8d329a2814bd2f962e04b8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=ec44993d0312f7a01556e63b6334fcd4 as ec44993d0312f7a01556e63b6334fcd4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=c2d95ec7372588b093dc8c22580052d5 as c2d95ec7372588b093dc8c22580052d5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,638 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(585): clone region=3438d437007cb2564d43ef73a69ef32a as 3438d437007cb2564d43ef73a69ef32a in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e717b28edc8d329a2814bd2f962e04b8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3de757b31d243ac95ceb60a256604797, NAME => 'testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => fa0bd967cfa5ceaa07640c9b2c7c5d58, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e4f9d9f31d365985d839e60788163871, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ec44993d0312f7a01556e63b6334fcd4, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 8d5c41d9f4ef726643d2645b4e448768, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,640 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 31bb9d0f03ebdf7f0614444194a0bf1f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,641 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 7b314c96f311aedb0be128dda80a1d5b, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,719 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,719 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 365917bde9c54126a59f4a7fe888a5ed from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,720 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,720 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e8e0b4a76894f2c968bfe8d20b5bde6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,728 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eff15cd284c442ae8205e261af330e1a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,728 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 70b5adc8a3e24ee5b6fd618d56b304ae from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,729 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,730 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4dc0cb34662f41f79662f255f669bdd8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3de757b31d243ac95ceb60a256604797, disabling compactions & flushes 2023-02-09 06:03:23,730 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. after waiting 0 ms 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,730 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:23,730 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3de757b31d243ac95ceb60a256604797: Waiting for close lock at 1675922603730Disabling compacts and flushes for region at 1675922603730Disabling writes for close at 1675922603730Writing region close event to WAL at 1675922603730Closed at 1675922603730 2023-02-09 06:03:23,731 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 90d39226463a4591babe0279dead3b49 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,731 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c2d95ec7372588b093dc8c22580052d5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 31bb9d0f03ebdf7f0614444194a0bf1f, disabling compactions & flushes 2023-02-09 06:03:23,733 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. after waiting 0 ms 2023-02-09 06:03:23,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,733 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:23,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Waiting for close lock at 1675922603733Disabling compacts and flushes for region at 1675922603733Disabling writes for close at 1675922603733Writing region close event to WAL at 1675922603733Closed at 1675922603733 2023-02-09 06:03:23,734 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3438d437007cb2564d43ef73a69ef32a, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:23,739 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ec44993d0312f7a01556e63b6334fcd4, disabling compactions & flushes 2023-02-09 06:03:23,739 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,739 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,739 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. after waiting 0 ms 2023-02-09 06:03:23,739 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,739 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:23,739 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ec44993d0312f7a01556e63b6334fcd4: Waiting for close lock at 1675922603739Disabling compacts and flushes for region at 1675922603739Disabling writes for close at 1675922603739Writing region close event to WAL at 1675922603739Closed at 1675922603739 2023-02-09 06:03:23,739 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68dfb3928bae4ac9984aadf3833ef068 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,740 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96ee3861a353469793582e2117857d25 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,742 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e4f9d9f31d365985d839e60788163871, disabling compactions & flushes 2023-02-09 06:03:23,742 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,742 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,742 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. after waiting 0 ms 2023-02-09 06:03:23,742 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,742 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:23,742 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e4f9d9f31d365985d839e60788163871: Waiting for close lock at 1675922603742Disabling compacts and flushes for region at 1675922603742Disabling writes for close at 1675922603742Writing region close event to WAL at 1675922603742Closed at 1675922603742 2023-02-09 06:03:23,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 7b314c96f311aedb0be128dda80a1d5b, disabling compactions & flushes 2023-02-09 06:03:23,748 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. after waiting 0 ms 2023-02-09 06:03:23,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,748 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:23,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 7b314c96f311aedb0be128dda80a1d5b: Waiting for close lock at 1675922603748Disabling compacts and flushes for region at 1675922603748Disabling writes for close at 1675922603748Writing region close event to WAL at 1675922603748Closed at 1675922603748 2023-02-09 06:03:23,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,750 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 09a51d77ca7d4908994f10f278ba6928 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,750 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:23,750 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5ad503b39d5a45cd93e871b8d6888fc9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,752 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 346acefbfbdd4fee9d12971fc14c5b4f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,752 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02175d6814ea40f8a8a756fafe542261 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c2d95ec7372588b093dc8c22580052d5, disabling compactions & flushes 2023-02-09 06:03:23,754 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. after waiting 0 ms 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3438d437007cb2564d43ef73a69ef32a, disabling compactions & flushes 2023-02-09 06:03:23,754 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:23,754 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c2d95ec7372588b093dc8c22580052d5: Waiting for close lock at 1675922603754Disabling compacts and flushes for region at 1675922603754Disabling writes for close at 1675922603754Writing region close event to WAL at 1675922603754Closed at 1675922603754 2023-02-09 06:03:23,754 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. after waiting 0 ms 2023-02-09 06:03:23,755 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,755 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:23,755 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3438d437007cb2564d43ef73a69ef32a: Waiting for close lock at 1675922603754Disabling compacts and flushes for region at 1675922603754Disabling writes for close at 1675922603755 (+1 ms)Writing region close event to WAL at 1675922603755Closed at 1675922603755 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,133 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e06b4a6147040cf9257cb574a500f7b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,133 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e8a3cc9664b47579e1c38de21cd1578 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 8d5c41d9f4ef726643d2645b4e448768, disabling compactions & flushes 2023-02-09 06:03:24,133 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. after waiting 0 ms 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,133 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 8d5c41d9f4ef726643d2645b4e448768: Waiting for close lock at 1675922604133Disabling compacts and flushes for region at 1675922604133Disabling writes for close at 1675922604133Writing region close event to WAL at 1675922604133Closed at 1675922604133 2023-02-09 06:03:24,135 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7883269936049eea7d2617ef6d0d9bb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,135 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1add4e0877a04ea081a379153b5e3c7d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,137 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e717b28edc8d329a2814bd2f962e04b8, disabling compactions & flushes 2023-02-09 06:03:24,137 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing fa0bd967cfa5ceaa07640c9b2c7c5d58, disabling compactions & flushes 2023-02-09 06:03:24,137 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,137 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,137 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. after waiting 0 ms 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. after waiting 0 ms 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,138 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,138 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Waiting for close lock at 1675922604137Disabling compacts and flushes for region at 1675922604137Disabling writes for close at 1675922604138 (+1 ms)Writing region close event to WAL at 1675922604138Closed at 1675922604138 2023-02-09 06:03:24,138 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e717b28edc8d329a2814bd2f962e04b8: Waiting for close lock at 1675922604137Disabling compacts and flushes for region at 1675922604137Disabling writes for close at 1675922604138 (+1 ms)Writing region close event to WAL at 1675922604138Closed at 1675922604138 2023-02-09 06:03:24,138 INFO [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675922601751 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:24,138 DEBUG [Listener at localhost/34763] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:24,138 DEBUG [Listener at localhost/34763] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b 2023-02-09 06:03:24,139 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:24,139 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:24,140 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-09 06:03:24,140 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------31bb9d0f03ebdf7f0614444194a0bf1f/ 2023-02-09 06:03:24,140 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,140 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,141 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=31bb9d0f03ebdf7f0614444194a0bf1f-365917bde9c54126a59f4a7fe888a5ed 2023-02-09 06:03:24,141 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,141 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=31bb9d0f03ebdf7f0614444194a0bf1f-70b5adc8a3e24ee5b6fd618d56b304ae 2023-02-09 06:03:24,141 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------3438d437007cb2564d43ef73a69ef32a/ 2023-02-09 06:03:24,141 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,142 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,142 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3438d437007cb2564d43ef73a69ef32a-5ad503b39d5a45cd93e871b8d6888fc9 2023-02-09 06:03:24,142 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,142 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3438d437007cb2564d43ef73a69ef32a-02175d6814ea40f8a8a756fafe542261 2023-02-09 06:03:24,142 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------3de757b31d243ac95ceb60a256604797/ 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------7b314c96f311aedb0be128dda80a1d5b/ 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7b314c96f311aedb0be128dda80a1d5b-4dc0cb34662f41f79662f255f669bdd8 2023-02-09 06:03:24,143 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7b314c96f311aedb0be128dda80a1d5b-96ee3861a353469793582e2117857d25 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------8d5c41d9f4ef726643d2645b4e448768/ 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------c2d95ec7372588b093dc8c22580052d5/ 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,144 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c2d95ec7372588b093dc8c22580052d5-09a51d77ca7d4908994f10f278ba6928 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c2d95ec7372588b093dc8c22580052d5-346acefbfbdd4fee9d12971fc14c5b4f 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------e4f9d9f31d365985d839e60788163871/ 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,145 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e4f9d9f31d365985d839e60788163871-90d39226463a4591babe0279dead3b49 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e4f9d9f31d365985d839e60788163871-68dfb3928bae4ac9984aadf3833ef068 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------e717b28edc8d329a2814bd2f962e04b8/ 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,146 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e717b28edc8d329a2814bd2f962e04b8-3e06b4a6147040cf9257cb574a500f7b 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e717b28edc8d329a2814bd2f962e04b8-a7883269936049eea7d2617ef6d0d9bb 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------ec44993d0312f7a01556e63b6334fcd4/ 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,147 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,148 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ec44993d0312f7a01556e63b6334fcd4-3e8e0b4a76894f2c968bfe8d20b5bde6 2023-02-09 06:03:24,148 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,148 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ec44993d0312f7a01556e63b6334fcd4-eff15cd284c442ae8205e261af330e1a 2023-02-09 06:03:24,148 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |----------fa0bd967cfa5ceaa07640c9b2c7c5d58/ 2023-02-09 06:03:24,149 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:24,149 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:24,149 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa0bd967cfa5ceaa07640c9b2c7c5d58-2e8a3cc9664b47579e1c38de21cd1578 2023-02-09 06:03:24,149 DEBUG [Listener at localhost/34763] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:24,149 DEBUG [Listener at localhost/34763] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa0bd967cfa5ceaa07640c9b2c7c5d58-1add4e0877a04ea081a379153b5e3c7d 2023-02-09 06:03:24,152 INFO [Listener at localhost/34763] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 06:03:24,700 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,700 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,702 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,704 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:24,705 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1 2023-02-09 06:03:24,705 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31bb9d0f03ebdf7f0614444194a0bf1f columnFamilyName f1 2023-02-09 06:03:24,709 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/testWithMockedMapReduceMultiRegion=31bb9d0f03ebdf7f0614444194a0bf1f-365917bde9c54126a59f4a7fe888a5ed 2023-02-09 06:03:24,709 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(310): Store=31bb9d0f03ebdf7f0614444194a0bf1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,710 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:24,710 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2 2023-02-09 06:03:24,711 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31bb9d0f03ebdf7f0614444194a0bf1f columnFamilyName f2 2023-02-09 06:03:24,714 DEBUG [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/testWithMockedMapReduceMultiRegion=31bb9d0f03ebdf7f0614444194a0bf1f-70b5adc8a3e24ee5b6fd618d56b304ae 2023-02-09 06:03:24,715 INFO [StoreOpener-31bb9d0f03ebdf7f0614444194a0bf1f-1] regionserver.HStore(310): Store=31bb9d0f03ebdf7f0614444194a0bf1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,715 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,715 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened 31bb9d0f03ebdf7f0614444194a0bf1f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63586998, jitterRate=-0.05247989296913147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,715 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Writing region info on filesystem at 1675922604702Initializing all the Stores at 1675922604702Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604703 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604703Region opened successfully at 1675922604715 (+12 ms) 2023-02-09 06:03:24,725 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing 31bb9d0f03ebdf7f0614444194a0bf1f, disabling compactions & flushes 2023-02-09 06:03:24,726 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:24,726 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:24,726 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. after waiting 0 ms 2023-02-09 06:03:24,726 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:24,728 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:24,728 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Waiting for close lock at 1675922604725Disabling compacts and flushes for region at 1675922604725Disabling writes for close at 1675922604726 (+1 ms)Writing region close event to WAL at 1675922604728 (+2 ms)Closed at 1675922604728 2023-02-09 06:03:24,729 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,729 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,734 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,736 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:24,737 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f1 2023-02-09 06:03:24,737 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3de757b31d243ac95ceb60a256604797 columnFamilyName f1 2023-02-09 06:03:24,738 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(310): Store=3de757b31d243ac95ceb60a256604797/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,738 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:24,739 DEBUG [StoreOpener-3de757b31d243ac95ceb60a256604797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f2 2023-02-09 06:03:24,739 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3de757b31d243ac95ceb60a256604797 columnFamilyName f2 2023-02-09 06:03:24,740 INFO [StoreOpener-3de757b31d243ac95ceb60a256604797-1] regionserver.HStore(310): Store=3de757b31d243ac95ceb60a256604797/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,740 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened 3de757b31d243ac95ceb60a256604797; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71200921, jitterRate=0.06097640097141266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for 3de757b31d243ac95ceb60a256604797: Writing region info on filesystem at 1675922604734Initializing all the Stores at 1675922604735 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604735Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604735Region opened successfully at 1675922604740 (+5 ms) 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing 3de757b31d243ac95ceb60a256604797, disabling compactions & flushes 2023-02-09 06:03:24,740 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. after waiting 0 ms 2023-02-09 06:03:24,740 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:24,743 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:24,743 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for 3de757b31d243ac95ceb60a256604797: Waiting for close lock at 1675922604740Disabling compacts and flushes for region at 1675922604740Disabling writes for close at 1675922604740Writing region close event to WAL at 1675922604743 (+3 ms)Closed at 1675922604743 2023-02-09 06:03:24,743 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,743 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,748 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,750 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:24,751 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1 2023-02-09 06:03:24,751 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3438d437007cb2564d43ef73a69ef32a columnFamilyName f1 2023-02-09 06:03:24,755 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/testWithMockedMapReduceMultiRegion=3438d437007cb2564d43ef73a69ef32a-5ad503b39d5a45cd93e871b8d6888fc9 2023-02-09 06:03:24,755 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(310): Store=3438d437007cb2564d43ef73a69ef32a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,755 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:24,756 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2 2023-02-09 06:03:24,756 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3438d437007cb2564d43ef73a69ef32a columnFamilyName f2 2023-02-09 06:03:24,759 DEBUG [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/testWithMockedMapReduceMultiRegion=3438d437007cb2564d43ef73a69ef32a-02175d6814ea40f8a8a756fafe542261 2023-02-09 06:03:24,759 INFO [StoreOpener-3438d437007cb2564d43ef73a69ef32a-1] regionserver.HStore(310): Store=3438d437007cb2564d43ef73a69ef32a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,759 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,760 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened 3438d437007cb2564d43ef73a69ef32a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67150973, jitterRate=6.27472996711731E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,760 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for 3438d437007cb2564d43ef73a69ef32a: Writing region info on filesystem at 1675922604748Initializing all the Stores at 1675922604748Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604748Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604749 (+1 ms)Region opened successfully at 1675922604760 (+11 ms) 2023-02-09 06:03:24,768 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing 3438d437007cb2564d43ef73a69ef32a, disabling compactions & flushes 2023-02-09 06:03:24,769 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:24,769 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:24,769 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. after waiting 0 ms 2023-02-09 06:03:24,769 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:24,769 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:24,769 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for 3438d437007cb2564d43ef73a69ef32a: Waiting for close lock at 1675922604768Disabling compacts and flushes for region at 1675922604768Disabling writes for close at 1675922604769 (+1 ms)Writing region close event to WAL at 1675922604769Closed at 1675922604769 2023-02-09 06:03:24,770 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,770 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,772 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,773 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:24,774 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1 2023-02-09 06:03:24,774 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b314c96f311aedb0be128dda80a1d5b columnFamilyName f1 2023-02-09 06:03:24,779 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/testWithMockedMapReduceMultiRegion=7b314c96f311aedb0be128dda80a1d5b-4dc0cb34662f41f79662f255f669bdd8 2023-02-09 06:03:24,779 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(310): Store=7b314c96f311aedb0be128dda80a1d5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,779 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:24,780 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2 2023-02-09 06:03:24,780 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b314c96f311aedb0be128dda80a1d5b columnFamilyName f2 2023-02-09 06:03:24,787 DEBUG [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/testWithMockedMapReduceMultiRegion=7b314c96f311aedb0be128dda80a1d5b-96ee3861a353469793582e2117857d25 2023-02-09 06:03:24,787 INFO [StoreOpener-7b314c96f311aedb0be128dda80a1d5b-1] regionserver.HStore(310): Store=7b314c96f311aedb0be128dda80a1d5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,787 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,787 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened 7b314c96f311aedb0be128dda80a1d5b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62759139, jitterRate=-0.064815953373909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,787 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for 7b314c96f311aedb0be128dda80a1d5b: Writing region info on filesystem at 1675922604772Initializing all the Stores at 1675922604773 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604773Region opened successfully at 1675922604787 (+14 ms) 2023-02-09 06:03:24,798 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing 7b314c96f311aedb0be128dda80a1d5b, disabling compactions & flushes 2023-02-09 06:03:24,798 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:24,798 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:24,798 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. after waiting 0 ms 2023-02-09 06:03:24,798 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:24,804 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:24,804 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for 7b314c96f311aedb0be128dda80a1d5b: Waiting for close lock at 1675922604798Disabling compacts and flushes for region at 1675922604798Disabling writes for close at 1675922604798Writing region close event to WAL at 1675922604804 (+6 ms)Closed at 1675922604804 2023-02-09 06:03:24,805 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,805 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,808 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,813 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:24,814 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1 2023-02-09 06:03:24,814 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f9d9f31d365985d839e60788163871 columnFamilyName f1 2023-02-09 06:03:24,819 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/testWithMockedMapReduceMultiRegion=e4f9d9f31d365985d839e60788163871-90d39226463a4591babe0279dead3b49 2023-02-09 06:03:24,819 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(310): Store=e4f9d9f31d365985d839e60788163871/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,819 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:24,820 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2 2023-02-09 06:03:24,820 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f9d9f31d365985d839e60788163871 columnFamilyName f2 2023-02-09 06:03:24,824 DEBUG [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/testWithMockedMapReduceMultiRegion=e4f9d9f31d365985d839e60788163871-68dfb3928bae4ac9984aadf3833ef068 2023-02-09 06:03:24,824 INFO [StoreOpener-e4f9d9f31d365985d839e60788163871-1] regionserver.HStore(310): Store=e4f9d9f31d365985d839e60788163871/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,825 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,825 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened e4f9d9f31d365985d839e60788163871; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69882905, jitterRate=0.041336432099342346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,825 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for e4f9d9f31d365985d839e60788163871: Writing region info on filesystem at 1675922604808Initializing all the Stores at 1675922604809 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604809Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604812 (+3 ms)Region opened successfully at 1675922604825 (+13 ms) 2023-02-09 06:03:24,835 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing e4f9d9f31d365985d839e60788163871, disabling compactions & flushes 2023-02-09 06:03:24,835 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:24,835 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:24,835 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. after waiting 0 ms 2023-02-09 06:03:24,835 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:24,836 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:24,836 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for e4f9d9f31d365985d839e60788163871: Waiting for close lock at 1675922604835Disabling compacts and flushes for region at 1675922604835Disabling writes for close at 1675922604835Writing region close event to WAL at 1675922604836 (+1 ms)Closed at 1675922604836 2023-02-09 06:03:24,837 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,837 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,841 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,843 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:24,844 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1 2023-02-09 06:03:24,844 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e717b28edc8d329a2814bd2f962e04b8 columnFamilyName f1 2023-02-09 06:03:24,848 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/testWithMockedMapReduceMultiRegion=e717b28edc8d329a2814bd2f962e04b8-3e06b4a6147040cf9257cb574a500f7b 2023-02-09 06:03:24,848 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(310): Store=e717b28edc8d329a2814bd2f962e04b8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,848 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:24,849 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2 2023-02-09 06:03:24,849 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e717b28edc8d329a2814bd2f962e04b8 columnFamilyName f2 2023-02-09 06:03:24,853 DEBUG [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/testWithMockedMapReduceMultiRegion=e717b28edc8d329a2814bd2f962e04b8-a7883269936049eea7d2617ef6d0d9bb 2023-02-09 06:03:24,853 INFO [StoreOpener-e717b28edc8d329a2814bd2f962e04b8-1] regionserver.HStore(310): Store=e717b28edc8d329a2814bd2f962e04b8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,853 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,853 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened e717b28edc8d329a2814bd2f962e04b8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71996039, jitterRate=0.07282458245754242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,853 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for e717b28edc8d329a2814bd2f962e04b8: Writing region info on filesystem at 1675922604841Initializing all the Stores at 1675922604842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604842Region opened successfully at 1675922604853 (+11 ms) 2023-02-09 06:03:24,862 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing e717b28edc8d329a2814bd2f962e04b8, disabling compactions & flushes 2023-02-09 06:03:24,862 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,862 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,862 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. after waiting 0 ms 2023-02-09 06:03:24,862 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,864 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:24,864 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for e717b28edc8d329a2814bd2f962e04b8: Waiting for close lock at 1675922604862Disabling compacts and flushes for region at 1675922604862Disabling writes for close at 1675922604862Writing region close event to WAL at 1675922604864 (+2 ms)Closed at 1675922604864 2023-02-09 06:03:24,864 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,865 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,866 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,868 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:24,869 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1 2023-02-09 06:03:24,869 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d95ec7372588b093dc8c22580052d5 columnFamilyName f1 2023-02-09 06:03:24,873 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/testWithMockedMapReduceMultiRegion=c2d95ec7372588b093dc8c22580052d5-09a51d77ca7d4908994f10f278ba6928 2023-02-09 06:03:24,873 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(310): Store=c2d95ec7372588b093dc8c22580052d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,873 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:24,874 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2 2023-02-09 06:03:24,874 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d95ec7372588b093dc8c22580052d5 columnFamilyName f2 2023-02-09 06:03:24,879 DEBUG [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/testWithMockedMapReduceMultiRegion=c2d95ec7372588b093dc8c22580052d5-346acefbfbdd4fee9d12971fc14c5b4f 2023-02-09 06:03:24,879 INFO [StoreOpener-c2d95ec7372588b093dc8c22580052d5-1] regionserver.HStore(310): Store=c2d95ec7372588b093dc8c22580052d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,880 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,880 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened c2d95ec7372588b093dc8c22580052d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74172512, jitterRate=0.10525655746459961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,880 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for c2d95ec7372588b093dc8c22580052d5: Writing region info on filesystem at 1675922604866Initializing all the Stores at 1675922604867 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604867Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604867Region opened successfully at 1675922604880 (+13 ms) 2023-02-09 06:03:24,888 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing c2d95ec7372588b093dc8c22580052d5, disabling compactions & flushes 2023-02-09 06:03:24,888 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:24,888 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:24,888 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. after waiting 0 ms 2023-02-09 06:03:24,888 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:24,889 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:24,889 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for c2d95ec7372588b093dc8c22580052d5: Waiting for close lock at 1675922604888Disabling compacts and flushes for region at 1675922604888Disabling writes for close at 1675922604888Writing region close event to WAL at 1675922604889 (+1 ms)Closed at 1675922604889 2023-02-09 06:03:24,889 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,890 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,893 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,895 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:24,895 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1 2023-02-09 06:03:24,896 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa0bd967cfa5ceaa07640c9b2c7c5d58 columnFamilyName f1 2023-02-09 06:03:24,899 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/testWithMockedMapReduceMultiRegion=fa0bd967cfa5ceaa07640c9b2c7c5d58-2e8a3cc9664b47579e1c38de21cd1578 2023-02-09 06:03:24,899 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(310): Store=fa0bd967cfa5ceaa07640c9b2c7c5d58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,899 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:24,900 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2 2023-02-09 06:03:24,900 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa0bd967cfa5ceaa07640c9b2c7c5d58 columnFamilyName f2 2023-02-09 06:03:24,905 DEBUG [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/testWithMockedMapReduceMultiRegion=fa0bd967cfa5ceaa07640c9b2c7c5d58-1add4e0877a04ea081a379153b5e3c7d 2023-02-09 06:03:24,905 INFO [StoreOpener-fa0bd967cfa5ceaa07640c9b2c7c5d58-1] regionserver.HStore(310): Store=fa0bd967cfa5ceaa07640c9b2c7c5d58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,905 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,905 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened fa0bd967cfa5ceaa07640c9b2c7c5d58; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69824872, jitterRate=0.040471673011779785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,906 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Writing region info on filesystem at 1675922604893Initializing all the Stores at 1675922604893Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604894 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604894Region opened successfully at 1675922604905 (+11 ms) 2023-02-09 06:03:24,913 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing fa0bd967cfa5ceaa07640c9b2c7c5d58, disabling compactions & flushes 2023-02-09 06:03:24,913 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,913 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,913 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. after waiting 0 ms 2023-02-09 06:03:24,913 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,914 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:24,914 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Waiting for close lock at 1675922604913Disabling compacts and flushes for region at 1675922604913Disabling writes for close at 1675922604913Writing region close event to WAL at 1675922604914 (+1 ms)Closed at 1675922604914 2023-02-09 06:03:24,915 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,915 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,916 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,918 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:24,919 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1 2023-02-09 06:03:24,919 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec44993d0312f7a01556e63b6334fcd4 columnFamilyName f1 2023-02-09 06:03:24,923 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/testWithMockedMapReduceMultiRegion=ec44993d0312f7a01556e63b6334fcd4-3e8e0b4a76894f2c968bfe8d20b5bde6 2023-02-09 06:03:24,923 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(310): Store=ec44993d0312f7a01556e63b6334fcd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,923 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:24,924 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2 2023-02-09 06:03:24,924 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec44993d0312f7a01556e63b6334fcd4 columnFamilyName f2 2023-02-09 06:03:24,927 DEBUG [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(539): loaded hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/testWithMockedMapReduceMultiRegion=ec44993d0312f7a01556e63b6334fcd4-eff15cd284c442ae8205e261af330e1a 2023-02-09 06:03:24,927 INFO [StoreOpener-ec44993d0312f7a01556e63b6334fcd4-1] regionserver.HStore(310): Store=ec44993d0312f7a01556e63b6334fcd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,927 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,927 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened ec44993d0312f7a01556e63b6334fcd4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65204048, jitterRate=-0.028383970260620117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,927 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for ec44993d0312f7a01556e63b6334fcd4: Writing region info on filesystem at 1675922604916Initializing all the Stores at 1675922604917 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604917Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604917Region opened successfully at 1675922604927 (+10 ms) 2023-02-09 06:03:24,935 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing ec44993d0312f7a01556e63b6334fcd4, disabling compactions & flushes 2023-02-09 06:03:24,936 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:24,936 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:24,936 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. after waiting 0 ms 2023-02-09 06:03:24,936 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:24,936 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:24,936 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for ec44993d0312f7a01556e63b6334fcd4: Waiting for close lock at 1675922604935Disabling compacts and flushes for region at 1675922604935Disabling writes for close at 1675922604936 (+1 ms)Writing region close event to WAL at 1675922604936Closed at 1675922604936 2023-02-09 06:03:24,937 DEBUG [Listener at localhost/34763] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:24,937 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:24,938 DEBUG [Listener at localhost/34763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:24,940 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:24,941 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f1 2023-02-09 06:03:24,942 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d5c41d9f4ef726643d2645b4e448768 columnFamilyName f1 2023-02-09 06:03:24,942 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(310): Store=8d5c41d9f4ef726643d2645b4e448768/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,942 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:24,943 DEBUG [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40195/user/jenkins/test-data/825e8a0b-0567-f44c-0b9d-14c72b7c0d0c/testWithMockedMapReduceMultiRegion/8e311b08-90f0-4cde-8174-598c23f4e44b/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f2 2023-02-09 06:03:24,943 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d5c41d9f4ef726643d2645b4e448768 columnFamilyName f2 2023-02-09 06:03:24,944 INFO [StoreOpener-8d5c41d9f4ef726643d2645b4e448768-1] regionserver.HStore(310): Store=8d5c41d9f4ef726643d2645b4e448768/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:24,944 INFO [Listener at localhost/34763] regionserver.HRegion(1071): Opened 8d5c41d9f4ef726643d2645b4e448768; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64989253, jitterRate=-0.031584665179252625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.HRegion(964): Region open journal for 8d5c41d9f4ef726643d2645b4e448768: Writing region info on filesystem at 1675922604939Initializing all the Stores at 1675922604939Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604939Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922604939Region opened successfully at 1675922604944 (+5 ms) 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.HRegion(1603): Closing 8d5c41d9f4ef726643d2645b4e448768, disabling compactions & flushes 2023-02-09 06:03:24,944 INFO [Listener at localhost/34763] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. after waiting 0 ms 2023-02-09 06:03:24,944 DEBUG [Listener at localhost/34763] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,944 INFO [Listener at localhost/34763] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:24,945 DEBUG [Listener at localhost/34763] regionserver.HRegion(1557): Region close journal for 8d5c41d9f4ef726643d2645b4e448768: Waiting for close lock at 1675922604944Disabling compacts and flushes for region at 1675922604944Disabling writes for close at 1675922604944Writing region close event to WAL at 1675922604944Closed at 1675922604944 2023-02-09 06:03:24,948 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:24,948 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:24,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-09 06:03:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,952 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:24,952 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:24,952 INFO [Listener at localhost/34763] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:24,955 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:24,955 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:24,956 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922604956"}]},"ts":"1675922604956"} 2023-02-09 06:03:24,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:24,957 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-09 06:03:24,958 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-09 06:03:24,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, UNASSIGN}] 2023-02-09 06:03:24,961 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, UNASSIGN 2023-02-09 06:03:24,961 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, UNASSIGN 2023-02-09 06:03:24,961 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, UNASSIGN 2023-02-09 06:03:24,962 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, UNASSIGN 2023-02-09 06:03:24,962 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, UNASSIGN 2023-02-09 06:03:24,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ec44993d0312f7a01556e63b6334fcd4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:24,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604962"}]},"ts":"1675922604962"} 2023-02-09 06:03:24,962 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3de757b31d243ac95ceb60a256604797, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:24,962 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e4f9d9f31d365985d839e60788163871, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:24,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e717b28edc8d329a2814bd2f962e04b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:24,962 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922604962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604962"}]},"ts":"1675922604962"} 2023-02-09 06:03:24,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604962"}]},"ts":"1675922604962"} 2023-02-09 06:03:24,962 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604962"}]},"ts":"1675922604962"} 2023-02-09 06:03:24,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8d5c41d9f4ef726643d2645b4e448768, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:24,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922604963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604963"}]},"ts":"1675922604963"} 2023-02-09 06:03:24,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure ec44993d0312f7a01556e63b6334fcd4, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:24,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 3de757b31d243ac95ceb60a256604797, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:24,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure e717b28edc8d329a2814bd2f962e04b8, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:24,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure e4f9d9f31d365985d839e60788163871, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:24,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 8d5c41d9f4ef726643d2645b4e448768, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:24,967 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, UNASSIGN 2023-02-09 06:03:24,967 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, UNASSIGN 2023-02-09 06:03:24,967 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, UNASSIGN 2023-02-09 06:03:24,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7b314c96f311aedb0be128dda80a1d5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:24,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604968"}]},"ts":"1675922604968"} 2023-02-09 06:03:24,968 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, UNASSIGN 2023-02-09 06:03:24,968 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3438d437007cb2564d43ef73a69ef32a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:24,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604968"}]},"ts":"1675922604968"} 2023-02-09 06:03:24,968 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c2d95ec7372588b093dc8c22580052d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:24,968 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604968"}]},"ts":"1675922604968"} 2023-02-09 06:03:24,969 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, UNASSIGN 2023-02-09 06:03:24,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fa0bd967cfa5ceaa07640c9b2c7c5d58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:24,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604969"}]},"ts":"1675922604969"} 2023-02-09 06:03:24,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=31bb9d0f03ebdf7f0614444194a0bf1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:24,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922604969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922604969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922604969"}]},"ts":"1675922604969"} 2023-02-09 06:03:24,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 7b314c96f311aedb0be128dda80a1d5b, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:24,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 3438d437007cb2564d43ef73a69ef32a, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:24,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure c2d95ec7372588b093dc8c22580052d5, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:24,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure fa0bd967cfa5ceaa07640c9b2c7c5d58, server=jenkins-hbase4.apache.org,38605,1675922599841}] 2023-02-09 06:03:24,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 31bb9d0f03ebdf7f0614444194a0bf1f, server=jenkins-hbase4.apache.org,40129,1675922599871}] 2023-02-09 06:03:25,056 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:25,057 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:25,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:25,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:25,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3438d437007cb2564d43ef73a69ef32a, disabling compactions & flushes 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c2d95ec7372588b093dc8c22580052d5, disabling compactions & flushes 2023-02-09 06:03:25,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:25,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. after waiting 0 ms 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. after waiting 0 ms 2023-02-09 06:03:25,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:25,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a. 2023-02-09 06:03:25,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3438d437007cb2564d43ef73a69ef32a: Waiting for close lock at 1675922605117Running coprocessor pre-close hooks at 1675922605117Disabling compacts and flushes for region at 1675922605117Disabling writes for close at 1675922605117Writing region close event to WAL at 1675922605118 (+1 ms)Running coprocessor post-close hooks at 1675922605121 (+3 ms)Closed at 1675922605123 (+2 ms) 2023-02-09 06:03:25,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5. 2023-02-09 06:03:25,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c2d95ec7372588b093dc8c22580052d5: Waiting for close lock at 1675922605117Running coprocessor pre-close hooks at 1675922605117Disabling compacts and flushes for region at 1675922605117Disabling writes for close at 1675922605117Writing region close event to WAL at 1675922605118 (+1 ms)Running coprocessor post-close hooks at 1675922605123 (+5 ms)Closed at 1675922605124 (+1 ms) 2023-02-09 06:03:25,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:25,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fa0bd967cfa5ceaa07640c9b2c7c5d58, disabling compactions & flushes 2023-02-09 06:03:25,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. after waiting 0 ms 2023-02-09 06:03:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:25,125 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3438d437007cb2564d43ef73a69ef32a, regionState=CLOSED 2023-02-09 06:03:25,125 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605125"}]},"ts":"1675922605125"} 2023-02-09 06:03:25,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:25,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:25,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3de757b31d243ac95ceb60a256604797, disabling compactions & flushes 2023-02-09 06:03:25,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:25,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:25,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. after waiting 0 ms 2023-02-09 06:03:25,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:25,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c2d95ec7372588b093dc8c22580052d5, regionState=CLOSED 2023-02-09 06:03:25,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605126"}]},"ts":"1675922605126"} 2023-02-09 06:03:25,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-09 06:03:25,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 3438d437007cb2564d43ef73a69ef32a, server=jenkins-hbase4.apache.org,38605,1675922599841 in 157 msec 2023-02-09 06:03:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:25,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-09 06:03:25,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure c2d95ec7372588b093dc8c22580052d5, server=jenkins-hbase4.apache.org,40129,1675922599871 in 157 msec 2023-02-09 06:03:25,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797. 2023-02-09 06:03:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3de757b31d243ac95ceb60a256604797: Waiting for close lock at 1675922605126Running coprocessor pre-close hooks at 1675922605126Disabling compacts and flushes for region at 1675922605126Disabling writes for close at 1675922605126Writing region close event to WAL at 1675922605126Running coprocessor post-close hooks at 1675922605130 (+4 ms)Closed at 1675922605131 (+1 ms) 2023-02-09 06:03:25,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3438d437007cb2564d43ef73a69ef32a, UNASSIGN in 170 msec 2023-02-09 06:03:25,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58. 2023-02-09 06:03:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fa0bd967cfa5ceaa07640c9b2c7c5d58: Waiting for close lock at 1675922605125Running coprocessor pre-close hooks at 1675922605125Disabling compacts and flushes for region at 1675922605125Disabling writes for close at 1675922605125Writing region close event to WAL at 1675922605126 (+1 ms)Running coprocessor post-close hooks at 1675922605131 (+5 ms)Closed at 1675922605132 (+1 ms) 2023-02-09 06:03:25,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2d95ec7372588b093dc8c22580052d5, UNASSIGN in 171 msec 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31bb9d0f03ebdf7f0614444194a0bf1f, disabling compactions & flushes 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. after waiting 0 ms 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:25,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3de757b31d243ac95ceb60a256604797, regionState=CLOSED 2023-02-09 06:03:25,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922605133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605133"}]},"ts":"1675922605133"} 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e717b28edc8d329a2814bd2f962e04b8, disabling compactions & flushes 2023-02-09 06:03:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. after waiting 0 ms 2023-02-09 06:03:25,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:25,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fa0bd967cfa5ceaa07640c9b2c7c5d58, regionState=CLOSED 2023-02-09 06:03:25,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605134"}]},"ts":"1675922605134"} 2023-02-09 06:03:25,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-09 06:03:25,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 3de757b31d243ac95ceb60a256604797, server=jenkins-hbase4.apache.org,40129,1675922599871 in 170 msec 2023-02-09 06:03:25,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-09 06:03:25,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure fa0bd967cfa5ceaa07640c9b2c7c5d58, server=jenkins-hbase4.apache.org,38605,1675922599841 in 163 msec 2023-02-09 06:03:25,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3de757b31d243ac95ceb60a256604797, UNASSIGN in 177 msec 2023-02-09 06:03:25,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa0bd967cfa5ceaa07640c9b2c7c5d58, UNASSIGN in 177 msec 2023-02-09 06:03:25,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f. 2023-02-09 06:03:25,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31bb9d0f03ebdf7f0614444194a0bf1f: Waiting for close lock at 1675922605133Running coprocessor pre-close hooks at 1675922605133Disabling compacts and flushes for region at 1675922605133Disabling writes for close at 1675922605133Writing region close event to WAL at 1675922605142 (+9 ms)Running coprocessor post-close hooks at 1675922605145 (+3 ms)Closed at 1675922605146 (+1 ms) 2023-02-09 06:03:25,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8. 2023-02-09 06:03:25,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e717b28edc8d329a2814bd2f962e04b8: Waiting for close lock at 1675922605133Running coprocessor pre-close hooks at 1675922605133Disabling compacts and flushes for region at 1675922605133Disabling writes for close at 1675922605133Writing region close event to WAL at 1675922605142 (+9 ms)Running coprocessor post-close hooks at 1675922605146 (+4 ms)Closed at 1675922605147 (+1 ms) 2023-02-09 06:03:25,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:25,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:25,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ec44993d0312f7a01556e63b6334fcd4, disabling compactions & flushes 2023-02-09 06:03:25,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:25,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:25,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. after waiting 0 ms 2023-02-09 06:03:25,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:25,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=31bb9d0f03ebdf7f0614444194a0bf1f, regionState=CLOSED 2023-02-09 06:03:25,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605149"}]},"ts":"1675922605149"} 2023-02-09 06:03:25,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:25,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:25,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8d5c41d9f4ef726643d2645b4e448768, disabling compactions & flushes 2023-02-09 06:03:25,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:25,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:25,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. after waiting 0 ms 2023-02-09 06:03:25,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:25,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e717b28edc8d329a2814bd2f962e04b8, regionState=CLOSED 2023-02-09 06:03:25,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605149"}]},"ts":"1675922605149"} 2023-02-09 06:03:25,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-09 06:03:25,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 31bb9d0f03ebdf7f0614444194a0bf1f, server=jenkins-hbase4.apache.org,40129,1675922599871 in 174 msec 2023-02-09 06:03:25,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-09 06:03:25,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure e717b28edc8d329a2814bd2f962e04b8, server=jenkins-hbase4.apache.org,38605,1675922599841 in 186 msec 2023-02-09 06:03:25,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=31bb9d0f03ebdf7f0614444194a0bf1f, UNASSIGN in 192 msec 2023-02-09 06:03:25,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e717b28edc8d329a2814bd2f962e04b8, UNASSIGN in 196 msec 2023-02-09 06:03:25,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 06:03:25,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4. 2023-02-09 06:03:25,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ec44993d0312f7a01556e63b6334fcd4: Waiting for close lock at 1675922605148Running coprocessor pre-close hooks at 1675922605148Disabling compacts and flushes for region at 1675922605148Disabling writes for close at 1675922605148Writing region close event to WAL at 1675922605152 (+4 ms)Running coprocessor post-close hooks at 1675922605158 (+6 ms)Closed at 1675922605158 2023-02-09 06:03:25,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768. 2023-02-09 06:03:25,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8d5c41d9f4ef726643d2645b4e448768: Waiting for close lock at 1675922605149Running coprocessor pre-close hooks at 1675922605149Disabling compacts and flushes for region at 1675922605149Disabling writes for close at 1675922605149Writing region close event to WAL at 1675922605152 (+3 ms)Running coprocessor post-close hooks at 1675922605159 (+7 ms)Closed at 1675922605159 2023-02-09 06:03:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7b314c96f311aedb0be128dda80a1d5b, disabling compactions & flushes 2023-02-09 06:03:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. after waiting 0 ms 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:25,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ec44993d0312f7a01556e63b6334fcd4, regionState=CLOSED 2023-02-09 06:03:25,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605161"}]},"ts":"1675922605161"} 2023-02-09 06:03:25,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:25,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e4f9d9f31d365985d839e60788163871, disabling compactions & flushes 2023-02-09 06:03:25,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. after waiting 0 ms 2023-02-09 06:03:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:25,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8d5c41d9f4ef726643d2645b4e448768, regionState=CLOSED 2023-02-09 06:03:25,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675922605161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605161"}]},"ts":"1675922605161"} 2023-02-09 06:03:25,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-09 06:03:25,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure ec44993d0312f7a01556e63b6334fcd4, server=jenkins-hbase4.apache.org,40129,1675922599871 in 199 msec 2023-02-09 06:03:25,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 06:03:25,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 8d5c41d9f4ef726643d2645b4e448768, server=jenkins-hbase4.apache.org,38605,1675922599841 in 197 msec 2023-02-09 06:03:25,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ec44993d0312f7a01556e63b6334fcd4, UNASSIGN in 205 msec 2023-02-09 06:03:25,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8d5c41d9f4ef726643d2645b4e448768, UNASSIGN in 206 msec 2023-02-09 06:03:25,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b. 2023-02-09 06:03:25,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:25,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7b314c96f311aedb0be128dda80a1d5b: Waiting for close lock at 1675922605160Running coprocessor pre-close hooks at 1675922605160Disabling compacts and flushes for region at 1675922605160Disabling writes for close at 1675922605161 (+1 ms)Writing region close event to WAL at 1675922605162 (+1 ms)Running coprocessor post-close hooks at 1675922605166 (+4 ms)Closed at 1675922605167 (+1 ms) 2023-02-09 06:03:25,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871. 2023-02-09 06:03:25,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e4f9d9f31d365985d839e60788163871: Waiting for close lock at 1675922605161Running coprocessor pre-close hooks at 1675922605161Disabling compacts and flushes for region at 1675922605161Disabling writes for close at 1675922605161Writing region close event to WAL at 1675922605163 (+2 ms)Running coprocessor post-close hooks at 1675922605168 (+5 ms)Closed at 1675922605168 2023-02-09 06:03:25,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:25,169 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7b314c96f311aedb0be128dda80a1d5b, regionState=CLOSED 2023-02-09 06:03:25,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605169"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605169"}]},"ts":"1675922605169"} 2023-02-09 06:03:25,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:25,170 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e4f9d9f31d365985d839e60788163871, regionState=CLOSED 2023-02-09 06:03:25,170 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675922605170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922605170"}]},"ts":"1675922605170"} 2023-02-09 06:03:25,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 06:03:25,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 7b314c96f311aedb0be128dda80a1d5b, server=jenkins-hbase4.apache.org,40129,1675922599871 in 201 msec 2023-02-09 06:03:25,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-09 06:03:25,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure e4f9d9f31d365985d839e60788163871, server=jenkins-hbase4.apache.org,38605,1675922599841 in 206 msec 2023-02-09 06:03:25,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b314c96f311aedb0be128dda80a1d5b, UNASSIGN in 213 msec 2023-02-09 06:03:25,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-09 06:03:25,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4f9d9f31d365985d839e60788163871, UNASSIGN in 214 msec 2023-02-09 06:03:25,174 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922605174"}]},"ts":"1675922605174"} 2023-02-09 06:03:25,175 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-09 06:03:25,179 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-09 06:03:25,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 226 msec 2023-02-09 06:03:25,258 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:25,258 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:25,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 06:03:25,260 INFO [Listener at localhost/34763] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-09 06:03:25,260 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:25,260 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:25,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,263 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:25,263 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:25,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:25,274 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:25,277 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/recovered.edits] 2023-02-09 06:03:25,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/recovered.edits] 2023-02-09 06:03:25,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/recovered.edits] 2023-02-09 06:03:25,279 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/recovered.edits] 2023-02-09 06:03:25,280 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/recovered.edits] 2023-02-09 06:03:25,280 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/recovered.edits] 2023-02-09 06:03:25,281 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/recovered.edits] 2023-02-09 06:03:25,281 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/recovered.edits] 2023-02-09 06:03:25,286 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/3e06b4a6147040cf9257cb574a500f7b 2023-02-09 06:03:25,287 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/09a51d77ca7d4908994f10f278ba6928 2023-02-09 06:03:25,287 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/3e8e0b4a76894f2c968bfe8d20b5bde6 2023-02-09 06:03:25,288 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/12ee5fbcf82c43038774bf8db56c5887 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/12ee5fbcf82c43038774bf8db56c5887 2023-02-09 06:03:25,288 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/2e8a3cc9664b47579e1c38de21cd1578 2023-02-09 06:03:25,293 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/365917bde9c54126a59f4a7fe888a5ed 2023-02-09 06:03:25,294 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/57199652bc5d4c3e93e6223fa986c7a5 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/57199652bc5d4c3e93e6223fa986c7a5 2023-02-09 06:03:25,294 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/d575014d47b24cfa998b345a8bfdce8f to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f1/d575014d47b24cfa998b345a8bfdce8f 2023-02-09 06:03:25,294 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/f20f7f3246a64aeda07242c4e8ccc962 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f1/f20f7f3246a64aeda07242c4e8ccc962 2023-02-09 06:03:25,296 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/460b0045c9744c309a3afe0cfa7fd95e to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f1/460b0045c9744c309a3afe0cfa7fd95e 2023-02-09 06:03:25,296 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f1/90d39226463a4591babe0279dead3b49 2023-02-09 06:03:25,296 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/6a88e7876d53497aab44bb8318cfeb4b to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f1/6a88e7876d53497aab44bb8318cfeb4b 2023-02-09 06:03:25,297 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/6a3bd261747549d3a95650cf36504a80 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f1/6a3bd261747549d3a95650cf36504a80 2023-02-09 06:03:25,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/recovered.edits/6.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797/recovered.edits/6.seqid 2023-02-09 06:03:25,298 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f1/5ad503b39d5a45cd93e871b8d6888fc9 2023-02-09 06:03:25,298 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3de757b31d243ac95ceb60a256604797 2023-02-09 06:03:25,298 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:25,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/346acefbfbdd4fee9d12971fc14c5b4f 2023-02-09 06:03:25,302 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/recovered.edits] 2023-02-09 06:03:25,308 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/0f1b789e98474cb193427910d5e41da7 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/0f1b789e98474cb193427910d5e41da7 2023-02-09 06:03:25,308 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/2a29398f71844cb299d471fb8351ec63 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/2a29398f71844cb299d471fb8351ec63 2023-02-09 06:03:25,310 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/eff15cd284c442ae8205e261af330e1a 2023-02-09 06:03:25,310 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/02175d6814ea40f8a8a756fafe542261 2023-02-09 06:03:25,310 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/5e04bb6175574178b42e84259de596b8 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/5e04bb6175574178b42e84259de596b8 2023-02-09 06:03:25,310 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/9d9766cf8df84ff4b63cb642d4e1c443 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/f2/9d9766cf8df84ff4b63cb642d4e1c443 2023-02-09 06:03:25,310 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/1add4e0877a04ea081a379153b5e3c7d 2023-02-09 06:03:25,312 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/f2/70b5adc8a3e24ee5b6fd618d56b304ae 2023-02-09 06:03:25,312 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/f2/a7883269936049eea7d2617ef6d0d9bb 2023-02-09 06:03:25,313 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/3c7aab24375f401aac381a8a205ccfbe to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/f2/3c7aab24375f401aac381a8a205ccfbe 2023-02-09 06:03:25,313 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/f2/68dfb3928bae4ac9984aadf3833ef068 2023-02-09 06:03:25,313 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/852323e1b47444dbb2a47b05167547b5 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/f2/852323e1b47444dbb2a47b05167547b5 2023-02-09 06:03:25,314 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/feb16b9fd8784646a8afc0396cfeccdd to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/f2/feb16b9fd8784646a8afc0396cfeccdd 2023-02-09 06:03:25,319 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/4dc0cb34662f41f79662f255f669bdd8 2023-02-09 06:03:25,320 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5/recovered.edits/12.seqid 2023-02-09 06:03:25,320 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58/recovered.edits/12.seqid 2023-02-09 06:03:25,321 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a/recovered.edits/12.seqid 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2d95ec7372588b093dc8c22580052d5 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f/recovered.edits/12.seqid 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871/recovered.edits/12.seqid 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa0bd967cfa5ceaa07640c9b2c7c5d58 2023-02-09 06:03:25,322 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8/recovered.edits/12.seqid 2023-02-09 06:03:25,323 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3438d437007cb2564d43ef73a69ef32a 2023-02-09 06:03:25,323 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/aafe9fedd3ad4b3384029832433ab1f7 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f1/aafe9fedd3ad4b3384029832433ab1f7 2023-02-09 06:03:25,323 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/31bb9d0f03ebdf7f0614444194a0bf1f 2023-02-09 06:03:25,326 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4f9d9f31d365985d839e60788163871 2023-02-09 06:03:25,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/e717b28edc8d329a2814bd2f962e04b8 2023-02-09 06:03:25,326 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4/recovered.edits/12.seqid 2023-02-09 06:03:25,327 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/ec44993d0312f7a01556e63b6334fcd4 2023-02-09 06:03:25,327 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f1, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/f2, FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/recovered.edits] 2023-02-09 06:03:25,329 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/963b96c5d6624cb3847a569ba967587a to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/963b96c5d6624cb3847a569ba967587a 2023-02-09 06:03:25,331 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25 to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/f2/96ee3861a353469793582e2117857d25 2023-02-09 06:03:25,332 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/recovered.edits/6.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768/recovered.edits/6.seqid 2023-02-09 06:03:25,333 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8d5c41d9f4ef726643d2645b4e448768 2023-02-09 06:03:25,334 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/recovered.edits/12.seqid to hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/archive/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b/recovered.edits/12.seqid 2023-02-09 06:03:25,334 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b314c96f311aedb0be128dda80a1d5b 2023-02-09 06:03:25,334 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 06:03:25,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,340 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-09 06:03:25,343 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922605344"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 06:03:25,346 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3de757b31d243ac95ceb60a256604797, NAME => 'testWithMockedMapReduceMultiRegion,,1675922601008.3de757b31d243ac95ceb60a256604797.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e4f9d9f31d365985d839e60788163871, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675922601008.e4f9d9f31d365985d839e60788163871.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => ec44993d0312f7a01556e63b6334fcd4, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675922601008.ec44993d0312f7a01556e63b6334fcd4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => e717b28edc8d329a2814bd2f962e04b8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675922601008.e717b28edc8d329a2814bd2f962e04b8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 31bb9d0f03ebdf7f0614444194a0bf1f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675922601008.31bb9d0f03ebdf7f0614444194a0bf1f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => fa0bd967cfa5ceaa07640c9b2c7c5d58, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675922601008.fa0bd967cfa5ceaa07640c9b2c7c5d58.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => c2d95ec7372588b093dc8c22580052d5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675922601008.c2d95ec7372588b093dc8c22580052d5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3438d437007cb2564d43ef73a69ef32a, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675922601008.3438d437007cb2564d43ef73a69ef32a.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7b314c96f311aedb0be128dda80a1d5b, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675922601008.7b314c96f311aedb0be128dda80a1d5b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 8d5c41d9f4ef726643d2645b4e448768, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675922601008.8d5c41d9f4ef726643d2645b4e448768.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 06:03:25,346 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-09 06:03:25,346 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922605346"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:25,348 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-09 06:03:25,350 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 06:03:25,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 90 msec 2023-02-09 06:03:25,364 INFO [Listener at localhost/34763] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:25,364 INFO [Listener at localhost/34763] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:25,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37713] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 06:03:25,366 INFO [Listener at localhost/34763] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-09 06:03:25,366 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:25,366 INFO [Listener at localhost/34763] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:25,366 DEBUG [Listener at localhost/34763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x728f52ef to 127.0.0.1:62943 2023-02-09 06:03:25,366 DEBUG [Listener at localhost/34763] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,366 DEBUG [Listener at localhost/34763] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:25,366 DEBUG [Listener at localhost/34763] util.JVMClusterUtil(257): Found active master hash=1783704368, stopped=false 2023-02-09 06:03:25,366 INFO [Listener at localhost/34763] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:25,368 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:25,368 INFO [Listener at localhost/34763] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:25,368 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:25,368 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:25,370 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:25,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:25,371 DEBUG [Listener at localhost/34763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2177d5c6 to 127.0.0.1:62943 2023-02-09 06:03:25,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:25,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:25,371 DEBUG [Listener at localhost/34763] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,371 INFO [Listener at localhost/34763] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38605,1675922599841' ***** 2023-02-09 06:03:25,371 INFO [Listener at localhost/34763] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:25,371 INFO [Listener at localhost/34763] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40129,1675922599871' ***** 2023-02-09 06:03:25,372 INFO [Listener at localhost/34763] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:25,372 DEBUG [RS:0;jenkins-hbase4:38605] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a13adf9 to 127.0.0.1:62943 2023-02-09 06:03:25,372 DEBUG [RS:0;jenkins-hbase4:38605] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:25,372 INFO [RS:0;jenkins-hbase4:38605] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:25,373 INFO [RS:1;jenkins-hbase4:40129] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:25,373 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:25,373 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:25,372 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:25,373 INFO [RS:1;jenkins-hbase4:40129] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:25,374 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 06:03:25,374 INFO [RS:1;jenkins-hbase4:40129] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:25,374 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 06:03:25,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:25,374 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(3304): Received CLOSE for da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:25,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:25,375 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:25,375 DEBUG [RS:1;jenkins-hbase4:40129] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67397cdc to 127.0.0.1:62943 2023-02-09 06:03:25,375 DEBUG [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 06:03:25,377 DEBUG [RS:1;jenkins-hbase4:40129] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da0ea5de7741c5eca33c43886a3f707f, disabling compactions & flushes 2023-02-09 06:03:25,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:25,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:25,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:25,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:25,377 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 06:03:25,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-09 06:03:25,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:25,378 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1479): Online Regions={da0ea5de7741c5eca33c43886a3f707f=hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f.} 2023-02-09 06:03:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. after waiting 0 ms 2023-02-09 06:03:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:25,378 DEBUG [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1505): Waiting on da0ea5de7741c5eca33c43886a3f707f 2023-02-09 06:03:25,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing da0ea5de7741c5eca33c43886a3f707f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:25,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/.tmp/info/4afea5be3b4e4101a09709a41a45e7eb 2023-02-09 06:03:25,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/info/b00e5e010213405e98fb857959b85a75 2023-02-09 06:03:25,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b00e5e010213405e98fb857959b85a75 2023-02-09 06:03:25,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/.tmp/info/4afea5be3b4e4101a09709a41a45e7eb as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/info/4afea5be3b4e4101a09709a41a45e7eb 2023-02-09 06:03:25,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/info/4afea5be3b4e4101a09709a41a45e7eb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:25,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for da0ea5de7741c5eca33c43886a3f707f in 22ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:25,404 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:25,404 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:25,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/rep_barrier/b2d6b101fcec471280146357f7d09e88 2023-02-09 06:03:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/namespace/da0ea5de7741c5eca33c43886a3f707f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:25,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:25,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da0ea5de7741c5eca33c43886a3f707f: Waiting for close lock at 1675922605375Running coprocessor pre-close hooks at 1675922605375Disabling compacts and flushes for region at 1675922605375Disabling writes for close at 1675922605378 (+3 ms)Obtaining lock to block concurrent updates at 1675922605378Preparing flush snapshotting stores in da0ea5de7741c5eca33c43886a3f707f at 1675922605378Finished memstore snapshotting hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922605378Flushing stores of hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. at 1675922605379 (+1 ms)Flushing da0ea5de7741c5eca33c43886a3f707f/info: creating writer at 1675922605379Flushing da0ea5de7741c5eca33c43886a3f707f/info: appending metadata at 1675922605381 (+2 ms)Flushing da0ea5de7741c5eca33c43886a3f707f/info: closing flushed file at 1675922605381Flushing da0ea5de7741c5eca33c43886a3f707f/info: reopening flushed file at 1675922605396 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for da0ea5de7741c5eca33c43886a3f707f in 22ms, sequenceid=6, compaction requested=false at 1675922605400 (+4 ms)Writing region close event to WAL at 1675922605404 (+4 ms)Running coprocessor post-close hooks at 1675922605410 (+6 ms)Closed at 1675922605411 (+1 ms) 2023-02-09 06:03:25,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922600452.da0ea5de7741c5eca33c43886a3f707f. 2023-02-09 06:03:25,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d6b101fcec471280146357f7d09e88 2023-02-09 06:03:25,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/table/69645c1937fd4f59b76b948cc6073e6a 2023-02-09 06:03:25,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69645c1937fd4f59b76b948cc6073e6a 2023-02-09 06:03:25,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/info/b00e5e010213405e98fb857959b85a75 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/info/b00e5e010213405e98fb857959b85a75 2023-02-09 06:03:25,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b00e5e010213405e98fb857959b85a75 2023-02-09 06:03:25,432 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/info/b00e5e010213405e98fb857959b85a75, entries=30, sequenceid=57, filesize=8.3 K 2023-02-09 06:03:25,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/rep_barrier/b2d6b101fcec471280146357f7d09e88 as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/rep_barrier/b2d6b101fcec471280146357f7d09e88 2023-02-09 06:03:25,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d6b101fcec471280146357f7d09e88 2023-02-09 06:03:25,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/rep_barrier/b2d6b101fcec471280146357f7d09e88, entries=10, sequenceid=57, filesize=6.1 K 2023-02-09 06:03:25,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/.tmp/table/69645c1937fd4f59b76b948cc6073e6a as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/table/69645c1937fd4f59b76b948cc6073e6a 2023-02-09 06:03:25,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69645c1937fd4f59b76b948cc6073e6a 2023-02-09 06:03:25,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/table/69645c1937fd4f59b76b948cc6073e6a, entries=13, sequenceid=57, filesize=6.1 K 2023-02-09 06:03:25,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false 2023-02-09 06:03:25,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 06:03:25,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:25,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:25,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922605374Running coprocessor pre-close hooks at 1675922605374Disabling compacts and flushes for region at 1675922605374Disabling writes for close at 1675922605377 (+3 ms)Obtaining lock to block concurrent updates at 1675922605378 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675922605378Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675922605378Flushing stores of hbase:meta,,1.1588230740 at 1675922605378Flushing 1588230740/info: creating writer at 1675922605379 (+1 ms)Flushing 1588230740/info: appending metadata at 1675922605381 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675922605381Flushing 1588230740/rep_barrier: creating writer at 1675922605395 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922605397 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922605397Flushing 1588230740/table: creating writer at 1675922605414 (+17 ms)Flushing 1588230740/table: appending metadata at 1675922605416 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675922605416Flushing 1588230740/info: reopening flushed file at 1675922605428 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922605433 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675922605438 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false at 1675922605443 (+5 ms)Writing region close event to WAL at 1675922605444 (+1 ms)Running coprocessor post-close hooks at 1675922605448 (+4 ms)Closed at 1675922605449 (+1 ms) 2023-02-09 06:03:25,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:25,577 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38605,1675922599841; all regions closed. 2023-02-09 06:03:25,578 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40129,1675922599871; all regions closed. 2023-02-09 06:03:25,585 DEBUG [RS:1;jenkins-hbase4:40129] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs 2023-02-09 06:03:25,585 DEBUG [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs 2023-02-09 06:03:25,585 INFO [RS:1;jenkins-hbase4:40129] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40129%2C1675922599871:(num 1675922600816) 2023-02-09 06:03:25,585 DEBUG [RS:1;jenkins-hbase4:40129] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,585 INFO [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38605%2C1675922599841.meta:.meta(num 1675922600395) 2023-02-09 06:03:25,585 INFO [RS:1;jenkins-hbase4:40129] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:25,586 INFO [RS:1;jenkins-hbase4:40129] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:25,586 INFO [RS:1;jenkins-hbase4:40129] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:25,586 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:25,586 INFO [RS:1;jenkins-hbase4:40129] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:25,586 INFO [RS:1;jenkins-hbase4:40129] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:25,587 INFO [RS:1;jenkins-hbase4:40129] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40129 2023-02-09 06:03:25,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:25,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:25,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:25,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40129,1675922599871 2023-02-09 06:03:25,589 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14997a04 rejected from java.util.concurrent.ThreadPoolExecutor@10a6ec4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:25,589 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b2d72cb rejected from java.util.concurrent.ThreadPoolExecutor@10a6ec4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,590 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40129,1675922599871] 2023-02-09 06:03:25,590 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40129,1675922599871; numProcessing=1 2023-02-09 06:03:25,590 DEBUG [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/oldWALs 2023-02-09 06:03:25,590 INFO [RS:0;jenkins-hbase4:38605] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38605%2C1675922599841:(num 1675922601181) 2023-02-09 06:03:25,590 DEBUG [RS:0;jenkins-hbase4:38605] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,590 INFO [RS:0;jenkins-hbase4:38605] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:25,591 INFO [RS:0;jenkins-hbase4:38605] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:25,591 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:25,592 INFO [RS:0;jenkins-hbase4:38605] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38605 2023-02-09 06:03:25,592 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40129,1675922599871 already deleted, retry=false 2023-02-09 06:03:25,592 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40129,1675922599871 expired; onlineServers=1 2023-02-09 06:03:25,593 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:25,593 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38605,1675922599841 2023-02-09 06:03:25,593 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76433c10 rejected from java.util.concurrent.ThreadPoolExecutor@727ca600[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,594 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38605,1675922599841] 2023-02-09 06:03:25,594 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38605,1675922599841; numProcessing=2 2023-02-09 06:03:25,595 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38605,1675922599841 already deleted, retry=false 2023-02-09 06:03:25,595 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38605,1675922599841 expired; onlineServers=0 2023-02-09 06:03:25,595 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37713,1675922599785' ***** 2023-02-09 06:03:25,595 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:25,596 DEBUG [M:0;jenkins-hbase4:37713] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e6ea2a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:25,596 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37713,1675922599785 2023-02-09 06:03:25,596 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37713,1675922599785; all regions closed. 2023-02-09 06:03:25,596 DEBUG [M:0;jenkins-hbase4:37713] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:25,596 DEBUG [M:0;jenkins-hbase4:37713] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:25,596 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:25,596 DEBUG [M:0;jenkins-hbase4:37713] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:25,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922600039] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922600039,5,FailOnTimeoutGroup] 2023-02-09 06:03:25,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922600039] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922600039,5,FailOnTimeoutGroup] 2023-02-09 06:03:25,596 INFO [M:0;jenkins-hbase4:37713] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:25,598 INFO [M:0;jenkins-hbase4:37713] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:25,598 INFO [M:0;jenkins-hbase4:37713] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:25,598 DEBUG [M:0;jenkins-hbase4:37713] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:25,598 INFO [M:0;jenkins-hbase4:37713] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:25,599 ERROR [M:0;jenkins-hbase4:37713] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:25,599 INFO [M:0;jenkins-hbase4:37713] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:25,599 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:25,599 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:25,599 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:25,599 DEBUG [M:0;jenkins-hbase4:37713] zookeeper.ZKUtil(398): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:25,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:25,599 WARN [M:0;jenkins-hbase4:37713] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:25,599 INFO [M:0;jenkins-hbase4:37713] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:25,600 INFO [M:0;jenkins-hbase4:37713] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:25,600 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:25,600 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:25,600 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:25,600 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:25,600 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:25,600 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.13 KB heapSize=200.04 KB 2023-02-09 06:03:25,611 INFO [M:0;jenkins-hbase4:37713] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.13 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e1c57693e67b4c56b8b2b4dbc2e3fddb 2023-02-09 06:03:25,615 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e1c57693e67b4c56b8b2b4dbc2e3fddb as hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e1c57693e67b4c56b8b2b4dbc2e3fddb 2023-02-09 06:03:25,619 INFO [M:0;jenkins-hbase4:37713] regionserver.HStore(1080): Added hdfs://localhost:40195/user/jenkins/test-data/34c78fc2-5b07-1ad5-8f52-59703734303e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e1c57693e67b4c56b8b2b4dbc2e3fddb, entries=53, sequenceid=357, filesize=10.7 K 2023-02-09 06:03:25,620 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegion(2947): Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=357, compaction requested=false 2023-02-09 06:03:25,620 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:25,620 DEBUG [M:0;jenkins-hbase4:37713] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922605600Disabling compacts and flushes for region at 1675922605600Disabling writes for close at 1675922605600Obtaining lock to block concurrent updates at 1675922605600Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922605600Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171142, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675922605601 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922605601Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922605602 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922605604 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922605604Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922605616 (+12 ms)Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=357, compaction requested=false at 1675922605620 (+4 ms)Writing region close event to WAL at 1675922605620Closed at 1675922605620 2023-02-09 06:03:25,623 INFO [M:0;jenkins-hbase4:37713] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:25,623 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:25,624 INFO [M:0;jenkins-hbase4:37713] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37713 2023-02-09 06:03:25,626 DEBUG [M:0;jenkins-hbase4:37713] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37713,1675922599785 already deleted, retry=false 2023-02-09 06:03:25,770 INFO [M:0;jenkins-hbase4:37713] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37713,1675922599785; zookeeper connection closed. 2023-02-09 06:03:25,770 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,771 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4488513b rejected from java.util.concurrent.ThreadPoolExecutor@40b7cd72[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,771 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:37713-0x10037ad59150000, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,771 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32fd8202 rejected from java.util.concurrent.ThreadPoolExecutor@40b7cd72[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,870 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,870 INFO [RS:0;jenkins-hbase4:38605] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38605,1675922599841; zookeeper connection closed. 2023-02-09 06:03:25,870 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69cf82f9 rejected from java.util.concurrent.ThreadPoolExecutor@727ca600[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,870 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:38605-0x10037ad59150001, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,870 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4b3f19fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4b3f19fd 2023-02-09 06:03:25,870 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11d86a1a rejected from java.util.concurrent.ThreadPoolExecutor@727ca600[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,970 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,970 INFO [RS:1;jenkins-hbase4:40129] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40129,1675922599871; zookeeper connection closed. 2023-02-09 06:03:25,970 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43583aac rejected from java.util.concurrent.ThreadPoolExecutor@10a6ec4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,970 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:40129-0x10037ad59150002, quorum=127.0.0.1:62943, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:25,970 ERROR [Listener at localhost/34763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65601820 rejected from java.util.concurrent.ThreadPoolExecutor@10a6ec4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:25,970 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72eb3816] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72eb3816 2023-02-09 06:03:25,971 INFO [Listener at localhost/34763] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:25,972 WARN [Listener at localhost/34763] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:25,975 INFO [Listener at localhost/34763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:26,081 WARN [BP-1650976832-172.31.14.131-1675922599192 heartbeating to localhost/127.0.0.1:40195] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:26,084 WARN [BP-1650976832-172.31.14.131-1675922599192 heartbeating to localhost/127.0.0.1:40195] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1650976832-172.31.14.131-1675922599192 (Datanode Uuid 778b97d4-c160-4df9-972e-ddb7c61e8b3b) service to localhost/127.0.0.1:40195 2023-02-09 06:03:26,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/dfs/data/data3/current/BP-1650976832-172.31.14.131-1675922599192] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:26,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/dfs/data/data4/current/BP-1650976832-172.31.14.131-1675922599192] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:26,087 WARN [Listener at localhost/34763] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:26,091 INFO [Listener at localhost/34763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:26,200 WARN [BP-1650976832-172.31.14.131-1675922599192 heartbeating to localhost/127.0.0.1:40195] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:26,200 WARN [BP-1650976832-172.31.14.131-1675922599192 heartbeating to localhost/127.0.0.1:40195] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1650976832-172.31.14.131-1675922599192 (Datanode Uuid a29b7ec7-2d03-46da-8db0-a108d178aa40) service to localhost/127.0.0.1:40195 2023-02-09 06:03:26,201 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/dfs/data/data1/current/BP-1650976832-172.31.14.131-1675922599192] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:26,201 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/cluster_4cf6a793-a354-849a-2f45-d5e8506aaf94/dfs/data/data2/current/BP-1650976832-172.31.14.131-1675922599192] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:26,212 INFO [Listener at localhost/34763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:26,331 INFO [Listener at localhost/34763] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:26,366 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:26,383 INFO [Listener at localhost/34763] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34763 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:40195 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40195 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40195 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40195 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40195 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:40195 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40195 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34763.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,37713,1675922599785)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=646 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 287), ProcessCount=166 (was 166), AvailableMemoryMB=3553 (was 3619) 2023-02-09 06:03:26,392 INFO [Listener at localhost/34763] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=166, AvailableMemoryMB=3552 2023-02-09 06:03:26,402 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.log.dir so I do NOT create it in target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7 2023-02-09 06:03:26,403 WARN [Listener at localhost/34763] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.tmp.dir so I do NOT create it in target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7 2023-02-09 06:03:26,403 WARN [Listener at localhost/34763] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fd5b0504-4215-9e84-7d82-5b5e5f0fe5e7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:26,403 DEBUG [Listener at localhost/34763] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0, deleteOnExit=true 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/test.cache.data in system properties and HBase conf 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:26,403 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:26,404 DEBUG [Listener at localhost/34763] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:26,404 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:26,405 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:26,409 WARN [Listener at localhost/34763] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:26,409 WARN [Listener at localhost/34763] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:26,446 WARN [Listener at localhost/34763] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 06:03:26,513 WARN [Listener at localhost/34763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:26,515 INFO [Listener at localhost/34763] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:26,520 INFO [Listener at localhost/34763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/java.io.tmpdir/Jetty_localhost_41743_hdfs____k3x3b7/webapp 2023-02-09 06:03:26,611 INFO [Listener at localhost/34763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41743 2023-02-09 06:03:26,615 WARN [Listener at localhost/34763] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:26,615 WARN [Listener at localhost/34763] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:26,653 WARN [Listener at localhost/34777] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:26,668 WARN [Listener at localhost/34777] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:26,672 WARN [Listener at localhost/34777] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:26,673 INFO [Listener at localhost/34777] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:26,678 INFO [Listener at localhost/34777] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/java.io.tmpdir/Jetty_localhost_32807_datanode____.2p6ahl/webapp 2023-02-09 06:03:26,768 INFO [Listener at localhost/34777] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32807 2023-02-09 06:03:26,777 WARN [Listener at localhost/43543] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:26,799 WARN [Listener at localhost/43543] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:26,801 WARN [Listener at localhost/43543] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:26,802 INFO [Listener at localhost/43543] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:26,806 INFO [Listener at localhost/43543] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/java.io.tmpdir/Jetty_localhost_45387_datanode____fw93g8/webapp 2023-02-09 06:03:26,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d53b1b49f23a116: Processing first storage report for DS-70f865db-3d4d-4cba-b308-905808641e52 from datanode 9487681a-8e03-4684-9f05-0010045cc85e 2023-02-09 06:03:26,867 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d53b1b49f23a116: from storage DS-70f865db-3d4d-4cba-b308-905808641e52 node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=9487681a-8e03-4684-9f05-0010045cc85e, infoPort=45945, infoSecurePort=0, ipcPort=43543, storageInfo=lv=-57;cid=testClusterID;nsid=174821574;c=1675922606411), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:26,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d53b1b49f23a116: Processing first storage report for DS-29accdbc-e481-408a-829d-8148c4a91c3b from datanode 9487681a-8e03-4684-9f05-0010045cc85e 2023-02-09 06:03:26,868 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d53b1b49f23a116: from storage DS-29accdbc-e481-408a-829d-8148c4a91c3b node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=9487681a-8e03-4684-9f05-0010045cc85e, infoPort=45945, infoSecurePort=0, ipcPort=43543, storageInfo=lv=-57;cid=testClusterID;nsid=174821574;c=1675922606411), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:26,916 INFO [Listener at localhost/43543] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45387 2023-02-09 06:03:26,924 WARN [Listener at localhost/37835] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:27,016 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17aea9a8328cd1f3: Processing first storage report for DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342 from datanode eac681ba-2874-4439-8d1a-8e4902524054 2023-02-09 06:03:27,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17aea9a8328cd1f3: from storage DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342 node DatanodeRegistration(127.0.0.1:36549, datanodeUuid=eac681ba-2874-4439-8d1a-8e4902524054, infoPort=45925, infoSecurePort=0, ipcPort=37835, storageInfo=lv=-57;cid=testClusterID;nsid=174821574;c=1675922606411), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:27,017 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17aea9a8328cd1f3: Processing first storage report for DS-26c8c568-db5b-4f3b-8468-167e742ecdd2 from datanode eac681ba-2874-4439-8d1a-8e4902524054 2023-02-09 06:03:27,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17aea9a8328cd1f3: from storage DS-26c8c568-db5b-4f3b-8468-167e742ecdd2 node DatanodeRegistration(127.0.0.1:36549, datanodeUuid=eac681ba-2874-4439-8d1a-8e4902524054, infoPort=45925, infoSecurePort=0, ipcPort=37835, storageInfo=lv=-57;cid=testClusterID;nsid=174821574;c=1675922606411), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:27,031 DEBUG [Listener at localhost/37835] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7 2023-02-09 06:03:27,034 INFO [Listener at localhost/37835] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/zookeeper_0, clientPort=50948, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:27,035 INFO [Listener at localhost/37835] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50948 2023-02-09 06:03:27,035 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,036 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,049 INFO [Listener at localhost/37835] util.FSUtils(479): Created version file at hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba with version=8 2023-02-09 06:03:27,049 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,050 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,052 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/hbase-staging 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:27,054 INFO [Listener at localhost/37835] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:27,055 INFO [Listener at localhost/37835] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37567 2023-02-09 06:03:27,055 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,056 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,058 INFO [Listener at localhost/37835] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37567 connecting to ZooKeeper ensemble=127.0.0.1:50948 2023-02-09 06:03:27,072 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:375670x0, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:27,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37567-0x10037ad757d0000 connected 2023-02-09 06:03:27,085 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:27,085 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:27,086 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:27,088 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37567 2023-02-09 06:03:27,088 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37567 2023-02-09 06:03:27,089 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37567 2023-02-09 06:03:27,090 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37567 2023-02-09 06:03:27,090 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37567 2023-02-09 06:03:27,090 INFO [Listener at localhost/37835] master.HMaster(439): hbase.rootdir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba, hbase.cluster.distributed=false 2023-02-09 06:03:27,102 INFO [Listener at localhost/37835] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:27,102 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:27,103 INFO [Listener at localhost/37835] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37477 2023-02-09 06:03:27,104 INFO [Listener at localhost/37835] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:27,110 DEBUG [Listener at localhost/37835] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:27,111 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,112 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,113 INFO [Listener at localhost/37835] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37477 connecting to ZooKeeper ensemble=127.0.0.1:50948 2023-02-09 06:03:27,117 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:374770x0, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:27,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37477-0x10037ad757d0001 connected 2023-02-09 06:03:27,118 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:27,119 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:27,119 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:27,120 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37477 2023-02-09 06:03:27,120 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37477 2023-02-09 06:03:27,120 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37477 2023-02-09 06:03:27,121 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37477 2023-02-09 06:03:27,121 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37477 2023-02-09 06:03:27,131 INFO [Listener at localhost/37835] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:27,131 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,132 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,132 INFO [Listener at localhost/37835] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:27,132 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:27,132 INFO [Listener at localhost/37835] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:27,132 INFO [Listener at localhost/37835] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:27,133 INFO [Listener at localhost/37835] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37287 2023-02-09 06:03:27,133 INFO [Listener at localhost/37835] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:27,136 DEBUG [Listener at localhost/37835] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:27,136 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,137 INFO [Listener at localhost/37835] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,138 INFO [Listener at localhost/37835] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37287 connecting to ZooKeeper ensemble=127.0.0.1:50948 2023-02-09 06:03:27,141 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:372870x0, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:27,142 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:372870x0, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:27,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37287-0x10037ad757d0002 connected 2023-02-09 06:03:27,143 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:27,143 DEBUG [Listener at localhost/37835] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:27,144 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37287 2023-02-09 06:03:27,144 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37287 2023-02-09 06:03:27,145 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37287 2023-02-09 06:03:27,148 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37287 2023-02-09 06:03:27,148 DEBUG [Listener at localhost/37835] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37287 2023-02-09 06:03:27,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,154 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:27,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,156 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:27,156 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:27,156 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:27,157 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:27,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37567,1675922607053 from backup master directory 2023-02-09 06:03:27,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:27,161 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,161 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:27,161 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:27,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/hbase.id with ID: 83361982-365b-4a5e-85a4-65cbc4c40e99 2023-02-09 06:03:27,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:27,183 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f5666d3 to 127.0.0.1:50948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:27,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e603a29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:27,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:27,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:27,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:27,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store-tmp 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:27,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:27,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:27,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922607204Disabling compacts and flushes for region at 1675922607204Disabling writes for close at 1675922607204Writing region close event to WAL at 1675922607204Closed at 1675922607204 2023-02-09 06:03:27,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/WALs/jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37567%2C1675922607053, suffix=, logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/WALs/jenkins-hbase4.apache.org,37567,1675922607053, archiveDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:27,227 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK] 2023-02-09 06:03:27,227 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK] 2023-02-09 06:03:27,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/WALs/jenkins-hbase4.apache.org,37567,1675922607053/jenkins-hbase4.apache.org%2C37567%2C1675922607053.1675922607207 2023-02-09 06:03:27,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK]] 2023-02-09 06:03:27,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:27,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:27,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,231 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,232 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:27,232 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:27,233 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:27,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:27,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63525219, jitterRate=-0.053400471806526184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:27,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922607230Initializing all the Stores at 1675922607230Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922607231 (+1 ms)Cleaning up temporary data from old regions at 1675922607234 (+3 ms)Cleaning up detritus from prior splits at 1675922607234Region opened successfully at 1675922607237 (+3 ms) 2023-02-09 06:03:27,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:27,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:27,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:27,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:27,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:27,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:27,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:27,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:27,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:27,254 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:27,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:27,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:27,257 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:27,257 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:27,257 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:27,257 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37567,1675922607053, sessionid=0x10037ad757d0000, setting cluster-up flag (Was=false) 2023-02-09 06:03:27,263 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:27,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,270 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:27,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:27,275 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/.tmp 2023-02-09 06:03:27,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:27,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:27,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:27,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:27,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:27,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:27,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:27,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922637278 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:27,279 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:27,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,279 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:27,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922607280,5,FailOnTimeoutGroup] 2023-02-09 06:03:27,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922607280,5,FailOnTimeoutGroup] 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,280 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:27,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,290 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:27,291 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:27,291 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba 2023-02-09 06:03:27,298 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:27,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:27,300 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/info 2023-02-09 06:03:27,300 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:27,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:27,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:27,302 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:27,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:27,304 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/table 2023-02-09 06:03:27,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:27,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,305 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740 2023-02-09 06:03:27,305 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740 2023-02-09 06:03:27,307 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:27,307 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:27,309 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73850881, jitterRate=0.1004638820886612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922607298Initializing all the Stores at 1675922607298Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922607298Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922607299 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922607299Cleaning up temporary data from old regions at 1675922607306 (+7 ms)Cleaning up detritus from prior splits at 1675922607306Region opened successfully at 1675922607309 (+3 ms) 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:27,309 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:27,309 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:27,310 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:27,310 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922607309Disabling compacts and flushes for region at 1675922607309Disabling writes for close at 1675922607309Writing region close event to WAL at 1675922607310 (+1 ms)Closed at 1675922607310 2023-02-09 06:03:27,310 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:27,310 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:27,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:27,312 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:27,313 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:27,354 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(952): ClusterId : 83361982-365b-4a5e-85a4-65cbc4c40e99 2023-02-09 06:03:27,354 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(952): ClusterId : 83361982-365b-4a5e-85a4-65cbc4c40e99 2023-02-09 06:03:27,354 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:27,354 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:27,361 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:27,361 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:27,361 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:27,361 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:27,363 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:27,364 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:27,364 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ReadOnlyZKClient(139): Connect 0x23fe29ef to 127.0.0.1:50948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:27,365 DEBUG [RS:0;jenkins-hbase4:37477] zookeeper.ReadOnlyZKClient(139): Connect 0x4e1cf437 to 127.0.0.1:50948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:27,372 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d39d3e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:27,372 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2906429f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:27,372 DEBUG [RS:0;jenkins-hbase4:37477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40db1384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:27,373 DEBUG [RS:0;jenkins-hbase4:37477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44e49f47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:27,381 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37287 2023-02-09 06:03:27,381 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37477 2023-02-09 06:03:27,381 INFO [RS:1;jenkins-hbase4:37287] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:27,381 INFO [RS:0;jenkins-hbase4:37477] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:27,381 INFO [RS:0;jenkins-hbase4:37477] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:27,381 INFO [RS:1;jenkins-hbase4:37287] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:27,381 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:27,381 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:27,382 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37567,1675922607053 with isa=jenkins-hbase4.apache.org/172.31.14.131:37477, startcode=1675922607102 2023-02-09 06:03:27,382 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37567,1675922607053 with isa=jenkins-hbase4.apache.org/172.31.14.131:37287, startcode=1675922607131 2023-02-09 06:03:27,382 DEBUG [RS:1;jenkins-hbase4:37287] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:27,382 DEBUG [RS:0;jenkins-hbase4:37477] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:27,384 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45393, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:27,384 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39131, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:27,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,387 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba 2023-02-09 06:03:27,387 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34777 2023-02-09 06:03:27,387 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:27,387 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba 2023-02-09 06:03:27,387 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34777 2023-02-09 06:03:27,387 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:27,391 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:27,391 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,391 DEBUG [RS:0;jenkins-hbase4:37477] zookeeper.ZKUtil(162): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,391 WARN [RS:1;jenkins-hbase4:37287] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:27,392 WARN [RS:0;jenkins-hbase4:37477] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:27,392 INFO [RS:1;jenkins-hbase4:37287] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:27,392 INFO [RS:0;jenkins-hbase4:37477] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:27,392 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,392 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,392 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37287,1675922607131] 2023-02-09 06:03:27,392 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37477,1675922607102] 2023-02-09 06:03:27,397 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,397 DEBUG [RS:0;jenkins-hbase4:37477] zookeeper.ZKUtil(162): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,397 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,398 DEBUG [RS:0;jenkins-hbase4:37477] zookeeper.ZKUtil(162): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,398 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:27,398 DEBUG [RS:0;jenkins-hbase4:37477] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:27,398 INFO [RS:1;jenkins-hbase4:37287] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:27,398 INFO [RS:0;jenkins-hbase4:37477] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:27,400 INFO [RS:1;jenkins-hbase4:37287] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:27,404 INFO [RS:0;jenkins-hbase4:37477] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:27,404 INFO [RS:1;jenkins-hbase4:37287] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:27,404 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,404 INFO [RS:0;jenkins-hbase4:37477] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:27,404 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,404 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:27,404 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:27,406 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,406 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,406 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:27,407 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:27,407 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,407 DEBUG [RS:0;jenkins-hbase4:37477] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:27,408 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,408 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,408 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,408 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,408 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,408 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,426 INFO [RS:1;jenkins-hbase4:37287] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:27,427 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37287,1675922607131-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,428 INFO [RS:0;jenkins-hbase4:37477] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:27,428 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37477,1675922607102-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,440 INFO [RS:1;jenkins-hbase4:37287] regionserver.Replication(203): jenkins-hbase4.apache.org,37287,1675922607131 started 2023-02-09 06:03:27,440 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37287,1675922607131, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37287, sessionid=0x10037ad757d0002 2023-02-09 06:03:27,440 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:27,440 DEBUG [RS:1;jenkins-hbase4:37287] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,440 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37287,1675922607131' 2023-02-09 06:03:27,440 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:27,440 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37287,1675922607131' 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:27,441 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:27,441 INFO [RS:1;jenkins-hbase4:37287] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:27,441 INFO [RS:1;jenkins-hbase4:37287] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:27,444 INFO [RS:0;jenkins-hbase4:37477] regionserver.Replication(203): jenkins-hbase4.apache.org,37477,1675922607102 started 2023-02-09 06:03:27,444 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37477,1675922607102, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37477, sessionid=0x10037ad757d0001 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37477,1675922607102' 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37477,1675922607102' 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:27,445 DEBUG [RS:0;jenkins-hbase4:37477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:27,446 DEBUG [RS:0;jenkins-hbase4:37477] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:27,446 INFO [RS:0;jenkins-hbase4:37477] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:27,446 INFO [RS:0;jenkins-hbase4:37477] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:27,463 DEBUG [jenkins-hbase4:37567] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:27,464 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:27,465 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:27,465 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:27,465 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:27,465 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37287,1675922607131, state=OPENING 2023-02-09 06:03:27,466 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:27,468 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:27,469 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:27,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37287,1675922607131}] 2023-02-09 06:03:27,625 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,625 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:27,627 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:27,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:27,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:27,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37287%2C1675922607131.meta, suffix=.meta, logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37287,1675922607131, archiveDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs, maxLogs=32 2023-02-09 06:03:27,644 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK] 2023-02-09 06:03:27,645 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK] 2023-02-09 06:03:27,646 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37287,1675922607131/jenkins-hbase4.apache.org%2C37287%2C1675922607131.meta.1675922607632.meta 2023-02-09 06:03:27,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK]] 2023-02-09 06:03:27,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:27,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:27,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:27,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:27,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/info 2023-02-09 06:03:27,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/info 2023-02-09 06:03:27,650 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:27,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:27,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:27,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:27,651 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:27,652 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,652 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:27,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/table 2023-02-09 06:03:27,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/table 2023-02-09 06:03:27,653 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:27,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:27,654 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740 2023-02-09 06:03:27,654 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740 2023-02-09 06:03:27,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:27,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:27,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63548229, jitterRate=-0.05305759608745575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:27,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922607647Writing region info on filesystem at 1675922607647Initializing all the Stores at 1675922607648 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922607648Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922607648Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922607648Cleaning up temporary data from old regions at 1675922607655 (+7 ms)Cleaning up detritus from prior splits at 1675922607655Running coprocessor post-open hooks at 1675922607657 (+2 ms)Region opened successfully at 1675922607657 2023-02-09 06:03:27,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922607625 2023-02-09 06:03:27,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:27,661 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:27,662 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37287,1675922607131, state=OPEN 2023-02-09 06:03:27,663 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:27,664 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:27,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:27,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37287,1675922607131 in 194 msec 2023-02-09 06:03:27,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:27,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-09 06:03:27,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-09 06:03:27,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922607155, completionTime=-1 2023-02-09 06:03:27,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:27,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:27,670 DEBUG [hconnection-0x2e77aa70-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:27,671 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:27,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:27,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922667672 2023-02-09 06:03:27,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922727672 2023-02-09 06:03:27,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1675922607053-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1675922607053-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1675922607053-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37567, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:27,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:27,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:27,698 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:27,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:27,700 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:27,700 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451 empty. 2023-02-09 06:03:27,700 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:27,701 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:27,711 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:27,712 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d7fca73a34ca26236bafaa50571e8451, NAME => 'hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp 2023-02-09 06:03:27,718 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:27,718 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d7fca73a34ca26236bafaa50571e8451, disabling compactions & flushes 2023-02-09 06:03:27,719 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:27,719 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:27,719 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. after waiting 0 ms 2023-02-09 06:03:27,719 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:27,719 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:27,719 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d7fca73a34ca26236bafaa50571e8451: Waiting for close lock at 1675922607718Disabling compacts and flushes for region at 1675922607718Disabling writes for close at 1675922607719 (+1 ms)Writing region close event to WAL at 1675922607719Closed at 1675922607719 2023-02-09 06:03:27,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:27,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922607721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922607721"}]},"ts":"1675922607721"} 2023-02-09 06:03:27,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:27,724 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:27,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922607724"}]},"ts":"1675922607724"} 2023-02-09 06:03:27,725 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:27,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:27,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:27,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:27,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:27,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d7fca73a34ca26236bafaa50571e8451, ASSIGN}] 2023-02-09 06:03:27,732 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d7fca73a34ca26236bafaa50571e8451, ASSIGN 2023-02-09 06:03:27,732 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d7fca73a34ca26236bafaa50571e8451, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1675922607131; forceNewPlan=false, retain=false 2023-02-09 06:03:27,883 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:27,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d7fca73a34ca26236bafaa50571e8451, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:27,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922607883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922607883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922607883"}]},"ts":"1675922607883"} 2023-02-09 06:03:27,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d7fca73a34ca26236bafaa50571e8451, server=jenkins-hbase4.apache.org,37287,1675922607131}] 2023-02-09 06:03:28,039 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:28,040 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37287%2C1675922607131, suffix=, logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37287,1675922607131, archiveDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs, maxLogs=32 2023-02-09 06:03:28,052 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK] 2023-02-09 06:03:28,052 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK] 2023-02-09 06:03:28,054 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37287,1675922607131/jenkins-hbase4.apache.org%2C37287%2C1675922607131.1675922608040 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK]] 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7fca73a34ca26236bafaa50571e8451, NAME => 'hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,055 INFO [StoreOpener-d7fca73a34ca26236bafaa50571e8451-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,056 DEBUG [StoreOpener-d7fca73a34ca26236bafaa50571e8451-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/info 2023-02-09 06:03:28,057 DEBUG [StoreOpener-d7fca73a34ca26236bafaa50571e8451-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/info 2023-02-09 06:03:28,057 INFO [StoreOpener-d7fca73a34ca26236bafaa50571e8451-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7fca73a34ca26236bafaa50571e8451 columnFamilyName info 2023-02-09 06:03:28,057 INFO [StoreOpener-d7fca73a34ca26236bafaa50571e8451-1] regionserver.HStore(310): Store=d7fca73a34ca26236bafaa50571e8451/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:28,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:28,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:28,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d7fca73a34ca26236bafaa50571e8451; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75231697, jitterRate=0.12103964388370514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:28,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d7fca73a34ca26236bafaa50571e8451: Running coprocessor pre-open hook at 1675922608054Writing region info on filesystem at 1675922608054Initializing all the Stores at 1675922608055 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922608055Cleaning up temporary data from old regions at 1675922608058 (+3 ms)Cleaning up detritus from prior splits at 1675922608059 (+1 ms)Running coprocessor post-open hooks at 1675922608062 (+3 ms)Region opened successfully at 1675922608062 2023-02-09 06:03:28,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451., pid=6, masterSystemTime=1675922608036 2023-02-09 06:03:28,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:28,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:28,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d7fca73a34ca26236bafaa50571e8451, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922608065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922608065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922608065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922608065"}]},"ts":"1675922608065"} 2023-02-09 06:03:28,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:28,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d7fca73a34ca26236bafaa50571e8451, server=jenkins-hbase4.apache.org,37287,1675922607131 in 182 msec 2023-02-09 06:03:28,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:28,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d7fca73a34ca26236bafaa50571e8451, ASSIGN in 338 msec 2023-02-09 06:03:28,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:28,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922608070"}]},"ts":"1675922608070"} 2023-02-09 06:03:28,071 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:28,073 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:28,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-09 06:03:28,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:28,095 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:28,095 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:28,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:28,105 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:28,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 06:03:28,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:28,114 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:28,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-09 06:03:28,126 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:28,128 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.967sec 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1675922607053-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:28,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1675922607053-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:28,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:28,154 DEBUG [Listener at localhost/37835] zookeeper.ReadOnlyZKClient(139): Connect 0x23bc2c65 to 127.0.0.1:50948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:28,164 DEBUG [Listener at localhost/37835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1abb258a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:28,165 DEBUG [hconnection-0x31994047-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:28,167 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:28,169 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:28,169 DEBUG [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:28,169 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,169 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,171 DEBUG [Listener at localhost/37835] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:28,172 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:28,173 INFO [Listener at localhost/37835] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:28,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:60430 deadline: 1675922668173, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,174 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-09 06:03:28,175 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,175 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:28,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,178 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:28,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-09 06:03:28,179 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,179 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:28,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:28,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc empty. 2023-02-09 06:03:28,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,181 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 06:03:28,193 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:28,194 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => f057cbc5363f298c9158daba57b1dfbc, NAME => 'testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing f057cbc5363f298c9158daba57b1dfbc, disabling compactions & flushes 2023-02-09 06:03:28,200 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. after waiting 0 ms 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,200 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for f057cbc5363f298c9158daba57b1dfbc: Waiting for close lock at 1675922608200Disabling compacts and flushes for region at 1675922608200Disabling writes for close at 1675922608200Writing region close event to WAL at 1675922608200Closed at 1675922608200 2023-02-09 06:03:28,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:28,203 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675922608203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922608203"}]},"ts":"1675922608203"} 2023-02-09 06:03:28,204 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:28,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:28,205 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922608205"}]},"ts":"1675922608205"} 2023-02-09 06:03:28,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-09 06:03:28,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:28,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:28,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:28,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:28,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, ASSIGN}] 2023-02-09 06:03:28,211 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, ASSIGN 2023-02-09 06:03:28,212 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1675922607131; forceNewPlan=false, retain=false 2023-02-09 06:03:28,280 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,280 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:28,363 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:28,363 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f057cbc5363f298c9158daba57b1dfbc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,363 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675922608363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922608363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922608363"}]},"ts":"1675922608363"} 2023-02-09 06:03:28,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure f057cbc5363f298c9158daba57b1dfbc, server=jenkins-hbase4.apache.org,37287,1675922607131}] 2023-02-09 06:03:28,448 INFO [RS:0;jenkins-hbase4:37477] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37477%2C1675922607102, suffix=, logDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37477,1675922607102, archiveDir=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs, maxLogs=32 2023-02-09 06:03:28,468 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK] 2023-02-09 06:03:28,468 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK] 2023-02-09 06:03:28,470 INFO [RS:0;jenkins-hbase4:37477] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/WALs/jenkins-hbase4.apache.org,37477,1675922607102/jenkins-hbase4.apache.org%2C37477%2C1675922607102.1675922608448 2023-02-09 06:03:28,470 DEBUG [RS:0;jenkins-hbase4:37477] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36549,DS-5baa3a2b-fea9-4bf6-942f-6f58099a9342,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-70f865db-3d4d-4cba-b308-905808641e52,DISK]] 2023-02-09 06:03:28,482 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,482 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:28,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f057cbc5363f298c9158daba57b1dfbc, NAME => 'testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,520 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,521 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1 2023-02-09 06:03:28,522 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1 2023-02-09 06:03:28,522 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f057cbc5363f298c9158daba57b1dfbc columnFamilyName f1 2023-02-09 06:03:28,522 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(310): Store=f057cbc5363f298c9158daba57b1dfbc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:28,522 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,523 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2 2023-02-09 06:03:28,523 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2 2023-02-09 06:03:28,524 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f057cbc5363f298c9158daba57b1dfbc columnFamilyName f2 2023-02-09 06:03:28,524 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(310): Store=f057cbc5363f298c9158daba57b1dfbc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:28,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:28,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:28,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f057cbc5363f298c9158daba57b1dfbc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65537246, jitterRate=-0.023418933153152466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f057cbc5363f298c9158daba57b1dfbc: Running coprocessor pre-open hook at 1675922608519Writing region info on filesystem at 1675922608519Initializing all the Stores at 1675922608520 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922608520Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922608520Cleaning up temporary data from old regions at 1675922608525 (+5 ms)Cleaning up detritus from prior splits at 1675922608526 (+1 ms)Running coprocessor post-open hooks at 1675922608529 (+3 ms)Region opened successfully at 1675922608529 2023-02-09 06:03:28,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc., pid=12, masterSystemTime=1675922608516 2023-02-09 06:03:28,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f057cbc5363f298c9158daba57b1dfbc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675922608531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922608531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922608531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922608531"}]},"ts":"1675922608531"} 2023-02-09 06:03:28,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 06:03:28,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure f057cbc5363f298c9158daba57b1dfbc, server=jenkins-hbase4.apache.org,37287,1675922607131 in 168 msec 2023-02-09 06:03:28,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 06:03:28,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, ASSIGN in 325 msec 2023-02-09 06:03:28,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:28,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922608536"}]},"ts":"1675922608536"} 2023-02-09 06:03:28,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-09 06:03:28,539 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:28,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 363 msec 2023-02-09 06:03:28,783 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,783 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:28,785 INFO [Listener at localhost/37835] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-09 06:03:28,785 DEBUG [Listener at localhost/37835] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-09 06:03:28,785 INFO [Listener at localhost/37835] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:28,787 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-09 06:03:28,787 INFO [Listener at localhost/37835] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:28,787 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-09 06:03:28,787 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:28,821 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,904 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:28,904 INFO [Listener at localhost/37835] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:28,905 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:28,905 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:28,906 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 06:03:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922608906 (current time:1675922608906). 2023-02-09 06:03:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x52050ec9 to 127.0.0.1:50948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:28,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dfc1aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:28,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:28,912 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52050ec9 to 127.0.0.1:50948 2023-02-09 06:03:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 06:03:28,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 06:03:28,917 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 06:03:28,917 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675923208917 2023-02-09 06:03:28,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 06:03:28,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,919 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:28,919 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:28,920 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 06:03:28,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 06:03:28,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 6 msec 2023-02-09 06:03:28,922 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 06:03:28,922 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675923208922 2023-02-09 06:03:28,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,934 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 06:03:28,934 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:28,935 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 06:03:28,935 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 06:03:28,935 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,935 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,937 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:28,937 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:28,937 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:28,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:28,937 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,937 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 06:03:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 06:03:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:28,940 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:28,941 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 06:03:28,941 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1675922607131' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 06:03:28,941 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:28,941 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 06:03:28,941 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37477,1675922607102' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 06:03:28,943 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1675922607131' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 06:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cfaadac[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:28,945 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 06:03:28,945 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,946 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,946 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37477,1675922607102' in zk 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 06:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:28,947 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:28,947 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:28,947 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:28,947 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. started... 2023-02-09 06:03:28,947 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f057cbc5363f298c9158daba57b1dfbc 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 06:03:28,948 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:28,948 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:28,948 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 06:03:28,967 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f1/153687164483404b92e7ae733b3e1532 2023-02-09 06:03:28,983 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f2/0c5420122efb41b9abbcbf9a3aa7338b 2023-02-09 06:03:28,988 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f1/153687164483404b92e7ae733b3e1532 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532 2023-02-09 06:03:28,991 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:28,992 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f2/0c5420122efb41b9abbcbf9a3aa7338b as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b 2023-02-09 06:03:28,995 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:28,996 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for f057cbc5363f298c9158daba57b1dfbc in 49ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:28,996 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f057cbc5363f298c9158daba57b1dfbc: 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532] hfiles 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b] hfiles 2023-02-09 06:03:28,997 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,002 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. completed. 2023-02-09 06:03:29,002 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,002 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 06:03:29,002 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 06:03:29,002 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,002 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 06:03:29,002 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37287,1675922607131' in zk 2023-02-09 06:03:29,005 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,005 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:29,005 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:29,005 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 06:03:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:29,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37287,1675922607131': 2023-02-09 06:03:29,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1675922607131' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:29,008 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 06:03:29,008 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:29,008 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:29,008 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,008 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:29,009 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,009 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:29,010 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:29,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:29,010 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,011 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,012 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:29,012 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:29,020 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:29,020 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:29,020 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:29,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:29,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:29,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,020 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,021 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:29,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:29,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:29,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,022 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:29,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-09 06:03:29,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,053 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675922608918Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675922609021 (+103 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675922609021Writing data manifest for testWithMockedMapReduceSingleRegion at 1675922609024 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675922609029 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675922609053 (+24 ms) 2023-02-09 06:03:29,055 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 06:03:29,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 136 msec 2023-02-09 06:03:29,222 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:29,222 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,222 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 06:03:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:29,224 INFO [Listener at localhost/37835] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:29,224 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,224 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,227 INFO [Listener at localhost/37835] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:29,232 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:29,259 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,409 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:29,413 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,413 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:29,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,417 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 06:03:29,417 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:29,418 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 06:03:29,418 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 06:03:29,418 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,418 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,419 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:29,419 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:29,419 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:29,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:29,420 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,420 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 06:03:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 06:03:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 06:03:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37477,1675922607102' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 06:03:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 06:03:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:29,423 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,423 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. started... 2023-02-09 06:03:29,423 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f057cbc5363f298c9158daba57b1dfbc 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 06:03:29,424 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:29,439 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f1/0c34b366f9e04c5facd0224494fd4624 2023-02-09 06:03:29,457 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f2/9bbb550fe776478fa2898c1717dbda13 2023-02-09 06:03:29,461 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f1/0c34b366f9e04c5facd0224494fd4624 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/0c34b366f9e04c5facd0224494fd4624 2023-02-09 06:03:29,464 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/0c34b366f9e04c5facd0224494fd4624, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:29,465 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/.tmp/f2/9bbb550fe776478fa2898c1717dbda13 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/9bbb550fe776478fa2898c1717dbda13 2023-02-09 06:03:29,468 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/9bbb550fe776478fa2898c1717dbda13, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:29,468 INFO [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for f057cbc5363f298c9158daba57b1dfbc in 45ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:29,470 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f057cbc5363f298c9158daba57b1dfbc: 2023-02-09 06:03:29,470 DEBUG [rs(jenkins-hbase4.apache.org,37287,1675922607131)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 06:03:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 06:03:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 06:03:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1675922607131' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 06:03:29,476 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,476 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:29,477 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,477 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:29,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1675922607131' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 06:03:29,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8c538eb[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:29,478 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 06:03:29,478 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,479 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,479 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 06:03:29,480 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,480 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37287,1675922607131' in zk 2023-02-09 06:03:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37477,1675922607102' in zk 2023-02-09 06:03:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:29,481 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1675922607131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 06:03:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,37477,1675922607102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 06:03:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37287,1675922607131': 2023-02-09 06:03:29,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1675922607131' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:29,484 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 06:03:29,484 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:29,484 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:29,484 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,484 INFO [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:29,486 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,486 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:29,486 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:29,486 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:29,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:29,487 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:29,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,487 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,488 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:29,489 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:29,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:29,491 DEBUG [(jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:29,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-09 06:03:29,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:29,491 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:29,492 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,492 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:29,492 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:29,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:29,592 DEBUG [Listener at localhost/37835] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:29,592 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,592 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:29,598 INFO [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675922608906 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:29,598 DEBUG [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15/data/default/testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,598 INFO [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(239): region to add: f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,598 INFO [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(585): clone region=f057cbc5363f298c9158daba57b1dfbc as f057cbc5363f298c9158daba57b1dfbc in snapshot testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,599 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f057cbc5363f298c9158daba57b1dfbc, NAME => 'testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15 2023-02-09 06:03:29,605 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:29,605 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 153687164483404b92e7ae733b3e1532 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,606 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c5420122efb41b9abbcbf9a3aa7338b from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,608 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f057cbc5363f298c9158daba57b1dfbc, disabling compactions & flushes 2023-02-09 06:03:29,608 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,608 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,608 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. after waiting 0 ms 2023-02-09 06:03:29,608 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,608 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,608 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f057cbc5363f298c9158daba57b1dfbc: Waiting for close lock at 1675922609608Disabling compacts and flushes for region at 1675922609608Disabling writes for close at 1675922609608Writing region close event to WAL at 1675922609608Closed at 1675922609608 2023-02-09 06:03:29,609 INFO [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675922608906 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:29,609 DEBUG [Listener at localhost/37835] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15 2023-02-09 06:03:29,609 DEBUG [Listener at localhost/37835] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15 2023-02-09 06:03:29,609 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:29,609 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:29,610 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-09 06:03:29,610 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |----------f057cbc5363f298c9158daba57b1dfbc/ 2023-02-09 06:03:29,610 DEBUG [Listener at localhost/37835] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:29,610 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:29,611 DEBUG [Listener at localhost/37835] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=f057cbc5363f298c9158daba57b1dfbc-153687164483404b92e7ae733b3e1532 2023-02-09 06:03:29,611 DEBUG [Listener at localhost/37835] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:29,611 DEBUG [Listener at localhost/37835] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=f057cbc5363f298c9158daba57b1dfbc-0c5420122efb41b9abbcbf9a3aa7338b 2023-02-09 06:03:29,613 INFO [Listener at localhost/37835] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 06:03:29,617 DEBUG [Listener at localhost/37835] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:29,617 INFO [Listener at localhost/37835] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:29,617 DEBUG [Listener at localhost/37835] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:29,619 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,620 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1 2023-02-09 06:03:29,620 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f057cbc5363f298c9158daba57b1dfbc columnFamilyName f1 2023-02-09 06:03:29,623 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(539): loaded hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/testWithMockedMapReduceSingleRegion=f057cbc5363f298c9158daba57b1dfbc-153687164483404b92e7ae733b3e1532 2023-02-09 06:03:29,623 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(310): Store=f057cbc5363f298c9158daba57b1dfbc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:29,623 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,624 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2 2023-02-09 06:03:29,624 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f057cbc5363f298c9158daba57b1dfbc columnFamilyName f2 2023-02-09 06:03:29,627 DEBUG [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(539): loaded hdfs://localhost:34777/user/jenkins/test-data/f13fde16-5073-5c0c-65fd-64090bf7c565/testWithMockedMapReduceSingleRegion/f0c43a3a-ad53-4e7b-bc33-581b830e5c15/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/testWithMockedMapReduceSingleRegion=f057cbc5363f298c9158daba57b1dfbc-0c5420122efb41b9abbcbf9a3aa7338b 2023-02-09 06:03:29,628 INFO [StoreOpener-f057cbc5363f298c9158daba57b1dfbc-1] regionserver.HStore(310): Store=f057cbc5363f298c9158daba57b1dfbc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:29,628 DEBUG [Listener at localhost/37835] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:29,628 INFO [Listener at localhost/37835] regionserver.HRegion(1071): Opened f057cbc5363f298c9158daba57b1dfbc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68485498, jitterRate=0.020513445138931274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:29,628 DEBUG [Listener at localhost/37835] regionserver.HRegion(964): Region open journal for f057cbc5363f298c9158daba57b1dfbc: Writing region info on filesystem at 1675922609617Initializing all the Stores at 1675922609618 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922609618Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922609618Region opened successfully at 1675922609628 (+10 ms) 2023-02-09 06:03:29,674 DEBUG [Listener at localhost/37835] regionserver.HRegion(1603): Closing f057cbc5363f298c9158daba57b1dfbc, disabling compactions & flushes 2023-02-09 06:03:29,674 INFO [Listener at localhost/37835] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,674 DEBUG [Listener at localhost/37835] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,674 DEBUG [Listener at localhost/37835] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. after waiting 0 ms 2023-02-09 06:03:29,674 DEBUG [Listener at localhost/37835] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,675 INFO [Listener at localhost/37835] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,675 DEBUG [Listener at localhost/37835] regionserver.HRegion(1557): Region close journal for f057cbc5363f298c9158daba57b1dfbc: Waiting for close lock at 1675922609674Disabling compacts and flushes for region at 1675922609674Disabling writes for close at 1675922609674Writing region close event to WAL at 1675922609675 (+1 ms)Closed at 1675922609675 2023-02-09 06:03:29,678 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,678 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,679 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-09 06:03:29,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,681 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,682 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,682 INFO [Listener at localhost/37835] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,685 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,685 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,685 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922609685"}]},"ts":"1675922609685"} 2023-02-09 06:03:29,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:29,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-09 06:03:29,688 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-09 06:03:29,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, UNASSIGN}] 2023-02-09 06:03:29,690 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, UNASSIGN 2023-02-09 06:03:29,690 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f057cbc5363f298c9158daba57b1dfbc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:29,690 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675922609690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922609690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922609690"}]},"ts":"1675922609690"} 2023-02-09 06:03:29,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure f057cbc5363f298c9158daba57b1dfbc, server=jenkins-hbase4.apache.org,37287,1675922607131}] 2023-02-09 06:03:29,786 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,786 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:29,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f057cbc5363f298c9158daba57b1dfbc, disabling compactions & flushes 2023-02-09 06:03:29,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. after waiting 0 ms 2023-02-09 06:03:29,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:29,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc. 2023-02-09 06:03:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f057cbc5363f298c9158daba57b1dfbc: Waiting for close lock at 1675922609844Running coprocessor pre-close hooks at 1675922609844Disabling compacts and flushes for region at 1675922609844Disabling writes for close at 1675922609844Writing region close event to WAL at 1675922609845 (+1 ms)Running coprocessor post-close hooks at 1675922609848 (+3 ms)Closed at 1675922609848 2023-02-09 06:03:29,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f057cbc5363f298c9158daba57b1dfbc, regionState=CLOSED 2023-02-09 06:03:29,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675922609850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922609850"}]},"ts":"1675922609850"} 2023-02-09 06:03:29,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 06:03:29,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure f057cbc5363f298c9158daba57b1dfbc, server=jenkins-hbase4.apache.org,37287,1675922607131 in 159 msec 2023-02-09 06:03:29,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 06:03:29,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=f057cbc5363f298c9158daba57b1dfbc, UNASSIGN in 164 msec 2023-02-09 06:03:29,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922609854"}]},"ts":"1675922609854"} 2023-02-09 06:03:29,855 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-09 06:03:29,857 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-09 06:03:29,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 175 msec 2023-02-09 06:03:29,987 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,987 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:29,989 INFO [Listener at localhost/37835] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-09 06:03:29,989 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,989 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,990 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,992 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,992 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:29,992 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:29,993 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:29,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:29,995 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:29,997 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1, FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2, FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/recovered.edits] 2023-02-09 06:03:30,000 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/0c34b366f9e04c5facd0224494fd4624 to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/archive/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/0c34b366f9e04c5facd0224494fd4624 2023-02-09 06:03:30,001 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532 to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/archive/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f1/153687164483404b92e7ae733b3e1532 2023-02-09 06:03:30,003 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/archive/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/0c5420122efb41b9abbcbf9a3aa7338b 2023-02-09 06:03:30,004 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/9bbb550fe776478fa2898c1717dbda13 to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/archive/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/f2/9bbb550fe776478fa2898c1717dbda13 2023-02-09 06:03:30,007 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/recovered.edits/12.seqid to hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/archive/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc/recovered.edits/12.seqid 2023-02-09 06:03:30,007 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/f057cbc5363f298c9158daba57b1dfbc 2023-02-09 06:03:30,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 06:03:30,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:30,010 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-09 06:03:30,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-09 06:03:30,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:30,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-09 06:03:30,013 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922610012"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:30,014 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 06:03:30,014 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f057cbc5363f298c9158daba57b1dfbc, NAME => 'testWithMockedMapReduceSingleRegion,,1675922608176.f057cbc5363f298c9158daba57b1dfbc.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 06:03:30,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-09 06:03:30,014 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922610014"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:30,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-09 06:03:30,024 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 06:03:30,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 34 msec 2023-02-09 06:03:30,093 INFO [Listener at localhost/37835] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:30,093 INFO [Listener at localhost/37835] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:30,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37567] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:30,095 INFO [Listener at localhost/37835] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-09 06:03:30,095 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:30,095 INFO [Listener at localhost/37835] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:30,095 DEBUG [Listener at localhost/37835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23bc2c65 to 127.0.0.1:50948 2023-02-09 06:03:30,095 DEBUG [Listener at localhost/37835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,095 DEBUG [Listener at localhost/37835] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:30,095 DEBUG [Listener at localhost/37835] util.JVMClusterUtil(257): Found active master hash=876574219, stopped=false 2023-02-09 06:03:30,096 INFO [Listener at localhost/37835] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:30,097 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:30,097 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:30,097 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:30,097 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:30,097 INFO [Listener at localhost/37835] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:30,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:30,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:30,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:30,099 DEBUG [Listener at localhost/37835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f5666d3 to 127.0.0.1:50948 2023-02-09 06:03:30,099 DEBUG [Listener at localhost/37835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,099 INFO [Listener at localhost/37835] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37477,1675922607102' ***** 2023-02-09 06:03:30,099 INFO [Listener at localhost/37835] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:30,099 INFO [Listener at localhost/37835] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37287,1675922607131' ***** 2023-02-09 06:03:30,099 INFO [Listener at localhost/37835] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:30,099 INFO [RS:0;jenkins-hbase4:37477] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:30,099 INFO [RS:1;jenkins-hbase4:37287] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:30,099 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:30,099 INFO [RS:1;jenkins-hbase4:37287] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:30,099 INFO [RS:0;jenkins-hbase4:37477] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:30,100 INFO [RS:1;jenkins-hbase4:37287] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:30,099 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:30,101 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(3304): Received CLOSE for d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:30,101 INFO [RS:0;jenkins-hbase4:37477] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d7fca73a34ca26236bafaa50571e8451, disabling compactions & flushes 2023-02-09 06:03:30,102 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:30,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:30,102 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23fe29ef to 127.0.0.1:50948 2023-02-09 06:03:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:30,102 DEBUG [RS:0;jenkins-hbase4:37477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e1cf437 to 127.0.0.1:50948 2023-02-09 06:03:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. after waiting 0 ms 2023-02-09 06:03:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:30,102 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d7fca73a34ca26236bafaa50571e8451 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:30,102 DEBUG [RS:0;jenkins-hbase4:37477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:30,102 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37477,1675922607102; all regions closed. 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:30,102 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 06:03:30,103 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1479): Online Regions={d7fca73a34ca26236bafaa50571e8451=hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 06:03:30,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:30,103 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1505): Waiting on 1588230740, d7fca73a34ca26236bafaa50571e8451 2023-02-09 06:03:30,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:30,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:30,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:30,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:30,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-09 06:03:30,106 DEBUG [RS:0;jenkins-hbase4:37477] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs 2023-02-09 06:03:30,106 INFO [RS:0;jenkins-hbase4:37477] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37477%2C1675922607102:(num 1675922608448) 2023-02-09 06:03:30,106 DEBUG [RS:0;jenkins-hbase4:37477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,106 INFO [RS:0;jenkins-hbase4:37477] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:30,107 INFO [RS:0;jenkins-hbase4:37477] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:30,107 INFO [RS:0;jenkins-hbase4:37477] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:30,107 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:30,107 INFO [RS:0;jenkins-hbase4:37477] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:30,107 INFO [RS:0;jenkins-hbase4:37477] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:30,108 INFO [RS:0;jenkins-hbase4:37477] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37477 2023-02-09 06:03:30,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/info/41a3a54536824afe975f66edac126ca9 2023-02-09 06:03:30,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/.tmp/info/08c89d651b1e4a5f81dbf7b285a6e628 2023-02-09 06:03:30,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41a3a54536824afe975f66edac126ca9 2023-02-09 06:03:30,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/.tmp/info/08c89d651b1e4a5f81dbf7b285a6e628 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/info/08c89d651b1e4a5f81dbf7b285a6e628 2023-02-09 06:03:30,125 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:30,125 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:30,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/info/08c89d651b1e4a5f81dbf7b285a6e628, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:30,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d7fca73a34ca26236bafaa50571e8451 in 27ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:30,136 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/rep_barrier/116f6cfd4ec045fcb2b93a3035535d80 2023-02-09 06:03:30,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/namespace/d7fca73a34ca26236bafaa50571e8451/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:30,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:30,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d7fca73a34ca26236bafaa50571e8451: Waiting for close lock at 1675922610102Running coprocessor pre-close hooks at 1675922610102Disabling compacts and flushes for region at 1675922610102Disabling writes for close at 1675922610102Obtaining lock to block concurrent updates at 1675922610102Preparing flush snapshotting stores in d7fca73a34ca26236bafaa50571e8451 at 1675922610102Finished memstore snapshotting hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922610102Flushing stores of hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. at 1675922610103 (+1 ms)Flushing d7fca73a34ca26236bafaa50571e8451/info: creating writer at 1675922610103Flushing d7fca73a34ca26236bafaa50571e8451/info: appending metadata at 1675922610113 (+10 ms)Flushing d7fca73a34ca26236bafaa50571e8451/info: closing flushed file at 1675922610113Flushing d7fca73a34ca26236bafaa50571e8451/info: reopening flushed file at 1675922610123 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d7fca73a34ca26236bafaa50571e8451 in 27ms, sequenceid=6, compaction requested=false at 1675922610129 (+6 ms)Writing region close event to WAL at 1675922610136 (+7 ms)Running coprocessor post-close hooks at 1675922610139 (+3 ms)Closed at 1675922610139 2023-02-09 06:03:30,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922607690.d7fca73a34ca26236bafaa50571e8451. 2023-02-09 06:03:30,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 116f6cfd4ec045fcb2b93a3035535d80 2023-02-09 06:03:30,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/table/7ab4a9f8cdfe42259efd96c405c665e7 2023-02-09 06:03:30,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ab4a9f8cdfe42259efd96c405c665e7 2023-02-09 06:03:30,149 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/info/41a3a54536824afe975f66edac126ca9 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/info/41a3a54536824afe975f66edac126ca9 2023-02-09 06:03:30,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41a3a54536824afe975f66edac126ca9 2023-02-09 06:03:30,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/info/41a3a54536824afe975f66edac126ca9, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 06:03:30,154 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/rep_barrier/116f6cfd4ec045fcb2b93a3035535d80 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/rep_barrier/116f6cfd4ec045fcb2b93a3035535d80 2023-02-09 06:03:30,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 116f6cfd4ec045fcb2b93a3035535d80 2023-02-09 06:03:30,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/rep_barrier/116f6cfd4ec045fcb2b93a3035535d80, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 06:03:30,159 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/.tmp/table/7ab4a9f8cdfe42259efd96c405c665e7 as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/table/7ab4a9f8cdfe42259efd96c405c665e7 2023-02-09 06:03:30,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ab4a9f8cdfe42259efd96c405c665e7 2023-02-09 06:03:30,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/table/7ab4a9f8cdfe42259efd96c405c665e7, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 06:03:30,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false 2023-02-09 06:03:30,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 06:03:30,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:30,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:30,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922610103Running coprocessor pre-close hooks at 1675922610103Disabling compacts and flushes for region at 1675922610103Disabling writes for close at 1675922610103Obtaining lock to block concurrent updates at 1675922610103Preparing flush snapshotting stores in 1588230740 at 1675922610103Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675922610103Flushing stores of hbase:meta,,1.1588230740 at 1675922610104 (+1 ms)Flushing 1588230740/info: creating writer at 1675922610105 (+1 ms)Flushing 1588230740/info: appending metadata at 1675922610107 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675922610107Flushing 1588230740/rep_barrier: creating writer at 1675922610122 (+15 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922610124 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922610124Flushing 1588230740/table: creating writer at 1675922610139 (+15 ms)Flushing 1588230740/table: appending metadata at 1675922610141 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675922610141Flushing 1588230740/info: reopening flushed file at 1675922610150 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922610155 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675922610159 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false at 1675922610165 (+6 ms)Writing region close event to WAL at 1675922610166 (+1 ms)Running coprocessor post-close hooks at 1675922610169 (+3 ms)Closed at 1675922610169 2023-02-09 06:03:30,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:30,206 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:30,206 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37477,1675922607102 2023-02-09 06:03:30,206 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:30,206 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:30,206 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2078ef19 rejected from java.util.concurrent.ThreadPoolExecutor@24477fce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,207 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:30,207 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37890750 rejected from java.util.concurrent.ThreadPoolExecutor@24477fce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,207 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37477,1675922607102] 2023-02-09 06:03:30,207 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37477,1675922607102; numProcessing=1 2023-02-09 06:03:30,208 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37477,1675922607102 already deleted, retry=false 2023-02-09 06:03:30,209 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37477,1675922607102 expired; onlineServers=1 2023-02-09 06:03:30,303 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37287,1675922607131; all regions closed. 2023-02-09 06:03:30,307 DEBUG [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs 2023-02-09 06:03:30,307 INFO [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37287%2C1675922607131.meta:.meta(num 1675922607632) 2023-02-09 06:03:30,310 DEBUG [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/oldWALs 2023-02-09 06:03:30,310 INFO [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37287%2C1675922607131:(num 1675922608040) 2023-02-09 06:03:30,310 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,310 INFO [RS:1;jenkins-hbase4:37287] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:30,310 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:30,310 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:30,311 INFO [RS:1;jenkins-hbase4:37287] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37287 2023-02-09 06:03:30,314 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37287,1675922607131 2023-02-09 06:03:30,314 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:30,314 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f228d9e rejected from java.util.concurrent.ThreadPoolExecutor@5b1d12a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,315 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37287,1675922607131] 2023-02-09 06:03:30,315 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37287,1675922607131; numProcessing=2 2023-02-09 06:03:30,316 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37287,1675922607131 already deleted, retry=false 2023-02-09 06:03:30,317 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37287,1675922607131 expired; onlineServers=0 2023-02-09 06:03:30,317 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37567,1675922607053' ***** 2023-02-09 06:03:30,317 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:30,317 DEBUG [M:0;jenkins-hbase4:37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3000f454, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:30,318 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37567,1675922607053 2023-02-09 06:03:30,318 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37567,1675922607053; all regions closed. 2023-02-09 06:03:30,318 DEBUG [M:0;jenkins-hbase4:37567] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:30,318 DEBUG [M:0;jenkins-hbase4:37567] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:30,318 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:30,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922607280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922607280,5,FailOnTimeoutGroup] 2023-02-09 06:03:30,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922607280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922607280,5,FailOnTimeoutGroup] 2023-02-09 06:03:30,318 DEBUG [M:0;jenkins-hbase4:37567] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:30,319 INFO [M:0;jenkins-hbase4:37567] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:30,319 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:30,319 INFO [M:0;jenkins-hbase4:37567] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:30,319 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:30,319 INFO [M:0;jenkins-hbase4:37567] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:30,319 DEBUG [M:0;jenkins-hbase4:37567] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:30,320 INFO [M:0;jenkins-hbase4:37567] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:30,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:30,320 ERROR [M:0;jenkins-hbase4:37567] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:30,320 INFO [M:0;jenkins-hbase4:37567] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:30,320 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:30,321 DEBUG [M:0;jenkins-hbase4:37567] zookeeper.ZKUtil(398): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:30,321 WARN [M:0;jenkins-hbase4:37567] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:30,321 INFO [M:0;jenkins-hbase4:37567] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:30,321 INFO [M:0;jenkins-hbase4:37567] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:30,321 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:30,321 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:30,321 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:30,321 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:30,322 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:30,322 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.11 KB heapSize=67.06 KB 2023-02-09 06:03:30,330 INFO [M:0;jenkins-hbase4:37567] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.11 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8705ad7fc24f4454a9bee2f5d4fb04de 2023-02-09 06:03:30,334 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8705ad7fc24f4454a9bee2f5d4fb04de as hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8705ad7fc24f4454a9bee2f5d4fb04de 2023-02-09 06:03:30,337 INFO [M:0;jenkins-hbase4:37567] regionserver.HStore(1080): Added hdfs://localhost:34777/user/jenkins/test-data/0f07c9aa-c1ec-79bc-c626-9b2e214fd6ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8705ad7fc24f4454a9bee2f5d4fb04de, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 06:03:30,338 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(2947): Finished flush of dataSize ~56.11 KB/57454, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-09 06:03:30,339 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:30,339 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922610321Disabling compacts and flushes for region at 1675922610321Disabling writes for close at 1675922610322 (+1 ms)Obtaining lock to block concurrent updates at 1675922610322Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922610322Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57454, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1675922610322Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922610323 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922610323Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922610325 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922610325Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922610334 (+9 ms)Finished flush of dataSize ~56.11 KB/57454, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675922610338 (+4 ms)Writing region close event to WAL at 1675922610339 (+1 ms)Closed at 1675922610339 2023-02-09 06:03:30,341 INFO [M:0;jenkins-hbase4:37567] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:30,341 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:30,342 INFO [M:0;jenkins-hbase4:37567] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37567 2023-02-09 06:03:30,345 DEBUG [M:0;jenkins-hbase4:37567] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37567,1675922607053 already deleted, retry=false 2023-02-09 06:03:30,498 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,498 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37567,1675922607053; zookeeper connection closed. 2023-02-09 06:03:30,498 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3baa9fb2 rejected from java.util.concurrent.ThreadPoolExecutor@3f951c1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,499 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10037ad757d0000, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,499 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@249f43bb rejected from java.util.concurrent.ThreadPoolExecutor@3f951c1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,549 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:30,598 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,598 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37287,1675922607131; zookeeper connection closed. 2023-02-09 06:03:30,599 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@644e565d rejected from java.util.concurrent.ThreadPoolExecutor@5b1d12a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,599 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x10037ad757d0002, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,599 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c70f66e rejected from java.util.concurrent.ThreadPoolExecutor@5b1d12a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,599 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@779d2cc2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@779d2cc2 2023-02-09 06:03:30,699 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,699 INFO [RS:0;jenkins-hbase4:37477] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37477,1675922607102; zookeeper connection closed. 2023-02-09 06:03:30,699 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4fc89a43 rejected from java.util.concurrent.ThreadPoolExecutor@24477fce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,699 DEBUG [Listener at localhost/37835-EventThread] zookeeper.ZKWatcher(600): regionserver:37477-0x10037ad757d0001, quorum=127.0.0.1:50948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:30,699 ERROR [Listener at localhost/37835-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ea62e97 rejected from java.util.concurrent.ThreadPoolExecutor@24477fce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:30,699 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10189348] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10189348 2023-02-09 06:03:30,700 INFO [Listener at localhost/37835] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:30,700 WARN [Listener at localhost/37835] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:30,703 INFO [Listener at localhost/37835] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:30,809 WARN [BP-2099236408-172.31.14.131-1675922606411 heartbeating to localhost/127.0.0.1:34777] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:30,809 WARN [BP-2099236408-172.31.14.131-1675922606411 heartbeating to localhost/127.0.0.1:34777] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2099236408-172.31.14.131-1675922606411 (Datanode Uuid eac681ba-2874-4439-8d1a-8e4902524054) service to localhost/127.0.0.1:34777 2023-02-09 06:03:30,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/dfs/data/data3/current/BP-2099236408-172.31.14.131-1675922606411] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:30,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/dfs/data/data4/current/BP-2099236408-172.31.14.131-1675922606411] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:30,811 WARN [Listener at localhost/37835] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:30,816 INFO [Listener at localhost/37835] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:30,920 WARN [BP-2099236408-172.31.14.131-1675922606411 heartbeating to localhost/127.0.0.1:34777] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:30,920 WARN [BP-2099236408-172.31.14.131-1675922606411 heartbeating to localhost/127.0.0.1:34777] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2099236408-172.31.14.131-1675922606411 (Datanode Uuid 9487681a-8e03-4684-9f05-0010045cc85e) service to localhost/127.0.0.1:34777 2023-02-09 06:03:30,921 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/dfs/data/data1/current/BP-2099236408-172.31.14.131-1675922606411] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:30,921 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/cluster_56fbc09d-5462-6f6f-9e08-bcf3b3673cd0/dfs/data/data2/current/BP-2099236408-172.31.14.131-1675922606411] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:30,930 INFO [Listener at localhost/37835] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:31,043 INFO [Listener at localhost/37835] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:31,073 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:31,085 INFO [Listener at localhost/37835] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 230) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34777 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34777 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37835 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34777 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34777 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,37567,1675922607053)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:34777 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37835.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:34777 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34777 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=663 (was 646) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 282), ProcessCount=166 (was 166), AvailableMemoryMB=3435 (was 3552) 2023-02-09 06:03:31,095 INFO [Listener at localhost/37835] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=663, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=166, AvailableMemoryMB=3434 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.log.dir so I do NOT create it in target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42 2023-02-09 06:03:31,105 WARN [Listener at localhost/37835] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.tmp.dir so I do NOT create it in target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42 2023-02-09 06:03:31,105 WARN [Listener at localhost/37835] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7edf7fcb-14b8-c4c4-5f22-eb8748088cb7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:31,105 DEBUG [Listener at localhost/37835] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f, deleteOnExit=true 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/test.cache.data in system properties and HBase conf 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:31,105 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:31,106 DEBUG [Listener at localhost/37835] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:31,106 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:31,107 INFO [Listener at localhost/37835] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:31,111 WARN [Listener at localhost/37835] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:31,112 WARN [Listener at localhost/37835] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:31,149 WARN [Listener at localhost/37835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:31,151 INFO [Listener at localhost/37835] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:31,155 INFO [Listener at localhost/37835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/java.io.tmpdir/Jetty_localhost_32925_hdfs____.eldfq1/webapp 2023-02-09 06:03:31,247 INFO [Listener at localhost/37835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32925 2023-02-09 06:03:31,251 WARN [Listener at localhost/37835] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:31,252 WARN [Listener at localhost/37835] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:31,298 WARN [Listener at localhost/34319] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:31,313 WARN [Listener at localhost/34319] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:31,320 WARN [Listener at localhost/34319] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:31,321 INFO [Listener at localhost/34319] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:31,327 INFO [Listener at localhost/34319] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/java.io.tmpdir/Jetty_localhost_42761_datanode____.qavmed/webapp 2023-02-09 06:03:31,426 INFO [Listener at localhost/34319] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42761 2023-02-09 06:03:31,433 WARN [Listener at localhost/38203] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:31,448 WARN [Listener at localhost/38203] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:31,450 WARN [Listener at localhost/38203] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:31,451 INFO [Listener at localhost/38203] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:31,455 INFO [Listener at localhost/38203] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/java.io.tmpdir/Jetty_localhost_40593_datanode____.n1bkw6/webapp 2023-02-09 06:03:31,542 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a380b74925e2d09: Processing first storage report for DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689 from datanode 03d666aa-58e5-4d36-999e-191ca7c6efad 2023-02-09 06:03:31,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a380b74925e2d09: from storage DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689 node DatanodeRegistration(127.0.0.1:45609, datanodeUuid=03d666aa-58e5-4d36-999e-191ca7c6efad, infoPort=37885, infoSecurePort=0, ipcPort=38203, storageInfo=lv=-57;cid=testClusterID;nsid=818309034;c=1675922611114), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:31,542 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a380b74925e2d09: Processing first storage report for DS-7ac76622-9c6a-4baa-9aff-268ea1c24a0d from datanode 03d666aa-58e5-4d36-999e-191ca7c6efad 2023-02-09 06:03:31,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a380b74925e2d09: from storage DS-7ac76622-9c6a-4baa-9aff-268ea1c24a0d node DatanodeRegistration(127.0.0.1:45609, datanodeUuid=03d666aa-58e5-4d36-999e-191ca7c6efad, infoPort=37885, infoSecurePort=0, ipcPort=38203, storageInfo=lv=-57;cid=testClusterID;nsid=818309034;c=1675922611114), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:31,555 INFO [Listener at localhost/38203] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40593 2023-02-09 06:03:31,561 WARN [Listener at localhost/37973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:31,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3f138b4082ac1f0: Processing first storage report for DS-48d39df5-42b8-4d9a-9803-f6b086189474 from datanode d5d02f8f-b99b-49db-9d68-e73042cf7a94 2023-02-09 06:03:31,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3f138b4082ac1f0: from storage DS-48d39df5-42b8-4d9a-9803-f6b086189474 node DatanodeRegistration(127.0.0.1:33649, datanodeUuid=d5d02f8f-b99b-49db-9d68-e73042cf7a94, infoPort=34311, infoSecurePort=0, ipcPort=37973, storageInfo=lv=-57;cid=testClusterID;nsid=818309034;c=1675922611114), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:31,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3f138b4082ac1f0: Processing first storage report for DS-84bb8093-1172-4688-a198-cec44e31e184 from datanode d5d02f8f-b99b-49db-9d68-e73042cf7a94 2023-02-09 06:03:31,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3f138b4082ac1f0: from storage DS-84bb8093-1172-4688-a198-cec44e31e184 node DatanodeRegistration(127.0.0.1:33649, datanodeUuid=d5d02f8f-b99b-49db-9d68-e73042cf7a94, infoPort=34311, infoSecurePort=0, ipcPort=37973, storageInfo=lv=-57;cid=testClusterID;nsid=818309034;c=1675922611114), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:31,670 DEBUG [Listener at localhost/37973] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42 2023-02-09 06:03:31,672 INFO [Listener at localhost/37973] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/zookeeper_0, clientPort=50565, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:31,673 INFO [Listener at localhost/37973] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50565 2023-02-09 06:03:31,673 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,674 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,687 INFO [Listener at localhost/37973] util.FSUtils(479): Created version file at hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118 with version=8 2023-02-09 06:03:31,688 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,688 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,689 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34319/user/jenkins/test-data/ae34758b-39a6-9070-e36e-2c751758edf4/hbase-staging 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:31,691 INFO [Listener at localhost/37973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:31,693 INFO [Listener at localhost/37973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36535 2023-02-09 06:03:31,693 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,694 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,695 INFO [Listener at localhost/37973] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36535 connecting to ZooKeeper ensemble=127.0.0.1:50565 2023-02-09 06:03:31,703 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:365350x0, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:31,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36535-0x10037ad879d0000 connected 2023-02-09 06:03:31,728 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:31,728 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:31,728 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:31,729 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36535 2023-02-09 06:03:31,729 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36535 2023-02-09 06:03:31,729 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36535 2023-02-09 06:03:31,730 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36535 2023-02-09 06:03:31,730 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36535 2023-02-09 06:03:31,730 INFO [Listener at localhost/37973] master.HMaster(439): hbase.rootdir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118, hbase.cluster.distributed=false 2023-02-09 06:03:31,743 INFO [Listener at localhost/37973] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:31,744 INFO [Listener at localhost/37973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:31,748 INFO [Listener at localhost/37973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36957 2023-02-09 06:03:31,749 INFO [Listener at localhost/37973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:31,757 DEBUG [Listener at localhost/37973] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:31,757 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,758 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,759 INFO [Listener at localhost/37973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36957 connecting to ZooKeeper ensemble=127.0.0.1:50565 2023-02-09 06:03:31,761 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:369570x0, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:31,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36957-0x10037ad879d0001 connected 2023-02-09 06:03:31,763 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:31,763 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:31,764 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:31,764 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36957 2023-02-09 06:03:31,764 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36957 2023-02-09 06:03:31,764 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36957 2023-02-09 06:03:31,765 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36957 2023-02-09 06:03:31,765 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36957 2023-02-09 06:03:31,775 INFO [Listener at localhost/37973] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:31,776 INFO [Listener at localhost/37973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:31,777 INFO [Listener at localhost/37973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39503 2023-02-09 06:03:31,777 INFO [Listener at localhost/37973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:31,777 DEBUG [Listener at localhost/37973] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:31,778 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,778 INFO [Listener at localhost/37973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,779 INFO [Listener at localhost/37973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39503 connecting to ZooKeeper ensemble=127.0.0.1:50565 2023-02-09 06:03:31,781 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:395030x0, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:31,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39503-0x10037ad879d0002 connected 2023-02-09 06:03:31,782 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:31,783 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:31,783 DEBUG [Listener at localhost/37973] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:31,783 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-09 06:03:31,784 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39503 2023-02-09 06:03:31,788 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39503 2023-02-09 06:03:31,789 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-09 06:03:31,789 DEBUG [Listener at localhost/37973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-09 06:03:31,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,793 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:31,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,795 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:31,795 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:31,795 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:31,796 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:31,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36535,1675922611690 from backup master directory 2023-02-09 06:03:31,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:31,800 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,800 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:31,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,800 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:31,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/hbase.id with ID: 3632e7ee-0dd1-411e-b9dd-fdeddd1e103f 2023-02-09 06:03:31,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:31,824 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x14795e41 to 127.0.0.1:50565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:31,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b7016e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:31,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:31,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:31,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:31,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store-tmp 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:31,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:31,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922611844Disabling compacts and flushes for region at 1675922611844Disabling writes for close at 1675922611844Writing region close event to WAL at 1675922611844Closed at 1675922611844 2023-02-09 06:03:31,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/WALs/jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36535%2C1675922611690, suffix=, logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/WALs/jenkins-hbase4.apache.org,36535,1675922611690, archiveDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:31,860 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK] 2023-02-09 06:03:31,860 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK] 2023-02-09 06:03:31,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/WALs/jenkins-hbase4.apache.org,36535,1675922611690/jenkins-hbase4.apache.org%2C36535%2C1675922611690.1675922611847 2023-02-09 06:03:31,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK], DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK]] 2023-02-09 06:03:31,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:31,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:31,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,863 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,864 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:31,864 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:31,865 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:31,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:31,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:31,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73042231, jitterRate=0.08841405808925629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:31,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922611862Initializing all the Stores at 1675922611863 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922611863Cleaning up temporary data from old regions at 1675922611866 (+3 ms)Cleaning up detritus from prior splits at 1675922611866Region opened successfully at 1675922611873 (+7 ms) 2023-02-09 06:03:31,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:31,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:31,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:31,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:31,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:31,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:31,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:31,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:31,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:31,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:31,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:31,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:31,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:31,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:31,890 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:31,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:31,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:31,893 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:31,893 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:31,893 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:31,893 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36535,1675922611690, sessionid=0x10037ad879d0000, setting cluster-up flag (Was=false) 2023-02-09 06:03:31,898 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:31,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,910 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:31,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:31,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:31,914 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/.tmp 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:31,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:31,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:31,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922641917 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:31,918 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:31,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:31,918 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:31,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922611919,5,FailOnTimeoutGroup] 2023-02-09 06:03:31,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922611919,5,FailOnTimeoutGroup] 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:31,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:31,919 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:31,926 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:31,927 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:31,927 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118 2023-02-09 06:03:31,934 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:31,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:31,935 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/info 2023-02-09 06:03:31,936 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:31,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:31,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:31,937 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:31,937 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:31,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:31,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:31,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/table 2023-02-09 06:03:31,938 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:31,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:31,939 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740 2023-02-09 06:03:31,939 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740 2023-02-09 06:03:31,941 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:31,941 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:31,943 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:31,943 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73089334, jitterRate=0.08911594748497009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:31,943 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922611934Initializing all the Stores at 1675922611934Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922611934Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922611934Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922611934Cleaning up temporary data from old regions at 1675922611940 (+6 ms)Cleaning up detritus from prior splits at 1675922611940Region opened successfully at 1675922611943 (+3 ms) 2023-02-09 06:03:31,943 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:31,944 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:31,944 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:31,944 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:31,944 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:31,944 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:31,944 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922611943Disabling compacts and flushes for region at 1675922611943Disabling writes for close at 1675922611944 (+1 ms)Writing region close event to WAL at 1675922611944Closed at 1675922611944 2023-02-09 06:03:31,945 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:31,945 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:31,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:31,946 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:31,947 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:31,992 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(952): ClusterId : 3632e7ee-0dd1-411e-b9dd-fdeddd1e103f 2023-02-09 06:03:31,992 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(952): ClusterId : 3632e7ee-0dd1-411e-b9dd-fdeddd1e103f 2023-02-09 06:03:31,992 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:31,992 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:31,995 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:31,995 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:31,995 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:31,995 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:31,997 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:31,998 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:31,999 DEBUG [RS:0;jenkins-hbase4:36957] zookeeper.ReadOnlyZKClient(139): Connect 0x40b23252 to 127.0.0.1:50565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:31,999 DEBUG [RS:1;jenkins-hbase4:39503] zookeeper.ReadOnlyZKClient(139): Connect 0x54594bb9 to 127.0.0.1:50565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:32,001 DEBUG [RS:1;jenkins-hbase4:39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a9ebf42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:32,001 DEBUG [RS:0;jenkins-hbase4:36957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e75c434, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:32,001 DEBUG [RS:1;jenkins-hbase4:39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea120c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:32,001 DEBUG [RS:0;jenkins-hbase4:36957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a4a5922, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:32,010 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39503 2023-02-09 06:03:32,010 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36957 2023-02-09 06:03:32,010 INFO [RS:1;jenkins-hbase4:39503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:32,010 INFO [RS:1;jenkins-hbase4:39503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:32,010 INFO [RS:0;jenkins-hbase4:36957] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:32,010 INFO [RS:0;jenkins-hbase4:36957] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:32,010 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:32,010 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:32,011 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36535,1675922611690 with isa=jenkins-hbase4.apache.org/172.31.14.131:39503, startcode=1675922611775 2023-02-09 06:03:32,011 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36535,1675922611690 with isa=jenkins-hbase4.apache.org/172.31.14.131:36957, startcode=1675922611743 2023-02-09 06:03:32,011 DEBUG [RS:1;jenkins-hbase4:39503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:32,011 DEBUG [RS:0;jenkins-hbase4:36957] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:32,013 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56971, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:32,013 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33815, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:32,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,015 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118 2023-02-09 06:03:32,015 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34319 2023-02-09 06:03:32,015 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118 2023-02-09 06:03:32,015 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:32,016 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34319 2023-02-09 06:03:32,016 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:32,018 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:32,021 DEBUG [RS:0;jenkins-hbase4:36957] zookeeper.ZKUtil(162): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,021 WARN [RS:0;jenkins-hbase4:36957] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:32,021 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36957,1675922611743] 2023-02-09 06:03:32,021 INFO [RS:0;jenkins-hbase4:36957] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:32,021 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39503,1675922611775] 2023-02-09 06:03:32,021 DEBUG [RS:1;jenkins-hbase4:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,021 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,021 WARN [RS:1;jenkins-hbase4:39503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:32,021 INFO [RS:1;jenkins-hbase4:39503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:32,021 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,025 DEBUG [RS:0;jenkins-hbase4:36957] zookeeper.ZKUtil(162): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,025 DEBUG [RS:1;jenkins-hbase4:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,026 DEBUG [RS:0;jenkins-hbase4:36957] zookeeper.ZKUtil(162): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,026 DEBUG [RS:1;jenkins-hbase4:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,026 DEBUG [RS:0;jenkins-hbase4:36957] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:32,026 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:32,026 INFO [RS:0;jenkins-hbase4:36957] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:32,026 INFO [RS:1;jenkins-hbase4:39503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:32,028 INFO [RS:0;jenkins-hbase4:36957] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:32,032 INFO [RS:0;jenkins-hbase4:36957] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:32,032 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,032 INFO [RS:1;jenkins-hbase4:39503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:32,032 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:32,036 INFO [RS:1;jenkins-hbase4:39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:32,036 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,037 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:32,038 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,038 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,038 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:32,039 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,039 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:0;jenkins-hbase4:36957] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,040 DEBUG [RS:1;jenkins-hbase4:39503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:32,041 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,041 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,041 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,041 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,041 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,042 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,052 INFO [RS:0;jenkins-hbase4:36957] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:32,053 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36957,1675922611743-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,053 INFO [RS:1;jenkins-hbase4:39503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:32,053 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39503,1675922611775-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,064 INFO [RS:0;jenkins-hbase4:36957] regionserver.Replication(203): jenkins-hbase4.apache.org,36957,1675922611743 started 2023-02-09 06:03:32,064 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36957,1675922611743, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36957, sessionid=0x10037ad879d0001 2023-02-09 06:03:32,064 INFO [RS:1;jenkins-hbase4:39503] regionserver.Replication(203): jenkins-hbase4.apache.org,39503,1675922611775 started 2023-02-09 06:03:32,064 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:32,064 DEBUG [RS:0;jenkins-hbase4:36957] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,064 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39503,1675922611775, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39503, sessionid=0x10037ad879d0002 2023-02-09 06:03:32,064 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36957,1675922611743' 2023-02-09 06:03:32,064 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:32,064 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:32,064 DEBUG [RS:1;jenkins-hbase4:39503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,064 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39503,1675922611775' 2023-02-09 06:03:32,064 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:32,064 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:32,064 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36957,1675922611743' 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39503,1675922611775' 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:32,065 DEBUG [RS:1;jenkins-hbase4:39503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:32,065 DEBUG [RS:0;jenkins-hbase4:36957] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:32,065 INFO [RS:0;jenkins-hbase4:36957] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:32,066 INFO [RS:0;jenkins-hbase4:36957] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:32,066 DEBUG [RS:1;jenkins-hbase4:39503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:32,066 INFO [RS:1;jenkins-hbase4:39503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:32,066 INFO [RS:1;jenkins-hbase4:39503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:32,098 DEBUG [jenkins-hbase4:36535] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:32,098 DEBUG [jenkins-hbase4:36535] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:32,099 DEBUG [jenkins-hbase4:36535] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:32,099 DEBUG [jenkins-hbase4:36535] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:32,099 DEBUG [jenkins-hbase4:36535] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:32,099 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39503,1675922611775, state=OPENING 2023-02-09 06:03:32,101 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:32,103 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:32,103 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:32,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39503,1675922611775}] 2023-02-09 06:03:32,258 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,258 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:32,259 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:32,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:32,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:32,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39503%2C1675922611775.meta, suffix=.meta, logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,39503,1675922611775, archiveDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs, maxLogs=32 2023-02-09 06:03:32,277 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK] 2023-02-09 06:03:32,277 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK] 2023-02-09 06:03:32,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,39503,1675922611775/jenkins-hbase4.apache.org%2C39503%2C1675922611775.meta.1675922612264.meta 2023-02-09 06:03:32,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK], DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK]] 2023-02-09 06:03:32,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:32,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:32,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:32,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:32,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:32,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:32,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:32,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:32,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:32,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/info 2023-02-09 06:03:32,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/info 2023-02-09 06:03:32,282 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:32,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:32,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:32,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:32,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:32,283 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:32,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:32,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:32,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/table 2023-02-09 06:03:32,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/table 2023-02-09 06:03:32,285 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:32,285 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:32,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740 2023-02-09 06:03:32,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740 2023-02-09 06:03:32,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:32,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:32,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62778041, jitterRate=-0.06453429162502289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:32,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922612280Writing region info on filesystem at 1675922612280Initializing all the Stores at 1675922612280Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922612280Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922612280Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922612280Cleaning up temporary data from old regions at 1675922612287 (+7 ms)Cleaning up detritus from prior splits at 1675922612287Running coprocessor post-open hooks at 1675922612289 (+2 ms)Region opened successfully at 1675922612289 2023-02-09 06:03:32,290 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922612258 2023-02-09 06:03:32,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:32,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:32,297 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39503,1675922611775, state=OPEN 2023-02-09 06:03:32,298 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:32,298 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:32,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:32,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39503,1675922611775 in 195 msec 2023-02-09 06:03:32,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:32,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-09 06:03:32,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 387 msec 2023-02-09 06:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922611793, completionTime=-1 2023-02-09 06:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:32,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:32,304 DEBUG [hconnection-0x279242f3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:32,305 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43648, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:32,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:32,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922672306 2023-02-09 06:03:32,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922732306 2023-02-09 06:03:32,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 3 msec 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36535,1675922611690-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36535,1675922611690-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36535,1675922611690-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36535, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:32,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:32,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:32,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:32,317 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:32,318 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:32,318 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:32,320 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,320 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c empty. 2023-02-09 06:03:32,320 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,320 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:32,328 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:32,329 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => da397822ed2d06c9dd5c2b3009b09d3c, NAME => 'hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing da397822ed2d06c9dd5c2b3009b09d3c, disabling compactions & flushes 2023-02-09 06:03:32,336 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. after waiting 0 ms 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,336 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,336 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for da397822ed2d06c9dd5c2b3009b09d3c: Waiting for close lock at 1675922612336Disabling compacts and flushes for region at 1675922612336Disabling writes for close at 1675922612336Writing region close event to WAL at 1675922612336Closed at 1675922612336 2023-02-09 06:03:32,338 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:32,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922612339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922612339"}]},"ts":"1675922612339"} 2023-02-09 06:03:32,340 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:32,341 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:32,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922612341"}]},"ts":"1675922612341"} 2023-02-09 06:03:32,342 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:32,345 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:32,346 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:32,346 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:32,346 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:32,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=da397822ed2d06c9dd5c2b3009b09d3c, ASSIGN}] 2023-02-09 06:03:32,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=da397822ed2d06c9dd5c2b3009b09d3c, ASSIGN 2023-02-09 06:03:32,349 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=da397822ed2d06c9dd5c2b3009b09d3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39503,1675922611775; forceNewPlan=false, retain=false 2023-02-09 06:03:32,499 INFO [jenkins-hbase4:36535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:32,500 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=da397822ed2d06c9dd5c2b3009b09d3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,500 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922612500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922612500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922612500"}]},"ts":"1675922612500"} 2023-02-09 06:03:32,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure da397822ed2d06c9dd5c2b3009b09d3c, server=jenkins-hbase4.apache.org,39503,1675922611775}] 2023-02-09 06:03:32,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,657 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39503%2C1675922611775, suffix=, logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,39503,1675922611775, archiveDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs, maxLogs=32 2023-02-09 06:03:32,669 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK] 2023-02-09 06:03:32,669 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK] 2023-02-09 06:03:32,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,39503,1675922611775/jenkins-hbase4.apache.org%2C39503%2C1675922611775.1675922612657 2023-02-09 06:03:32,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK], DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK]] 2023-02-09 06:03:32,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da397822ed2d06c9dd5c2b3009b09d3c, NAME => 'hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:32,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:32,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,673 INFO [StoreOpener-da397822ed2d06c9dd5c2b3009b09d3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,674 DEBUG [StoreOpener-da397822ed2d06c9dd5c2b3009b09d3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/info 2023-02-09 06:03:32,674 DEBUG [StoreOpener-da397822ed2d06c9dd5c2b3009b09d3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/info 2023-02-09 06:03:32,674 INFO [StoreOpener-da397822ed2d06c9dd5c2b3009b09d3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da397822ed2d06c9dd5c2b3009b09d3c columnFamilyName info 2023-02-09 06:03:32,674 INFO [StoreOpener-da397822ed2d06c9dd5c2b3009b09d3c-1] regionserver.HStore(310): Store=da397822ed2d06c9dd5c2b3009b09d3c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:32,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:32,678 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:32,679 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da397822ed2d06c9dd5c2b3009b09d3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62789169, jitterRate=-0.06436847150325775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:32,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da397822ed2d06c9dd5c2b3009b09d3c: Running coprocessor pre-open hook at 1675922612672Writing region info on filesystem at 1675922612672Initializing all the Stores at 1675922612672Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922612672Cleaning up temporary data from old regions at 1675922612676 (+4 ms)Cleaning up detritus from prior splits at 1675922612676Running coprocessor post-open hooks at 1675922612679 (+3 ms)Region opened successfully at 1675922612679 2023-02-09 06:03:32,680 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c., pid=6, masterSystemTime=1675922612653 2023-02-09 06:03:32,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,683 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:32,683 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=da397822ed2d06c9dd5c2b3009b09d3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:32,683 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922612683"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922612683"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922612683"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922612683"}]},"ts":"1675922612683"} 2023-02-09 06:03:32,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:32,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure da397822ed2d06c9dd5c2b3009b09d3c, server=jenkins-hbase4.apache.org,39503,1675922611775 in 183 msec 2023-02-09 06:03:32,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:32,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=da397822ed2d06c9dd5c2b3009b09d3c, ASSIGN in 340 msec 2023-02-09 06:03:32,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:32,688 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922612688"}]},"ts":"1675922612688"} 2023-02-09 06:03:32,689 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:32,692 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:32,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 376 msec 2023-02-09 06:03:32,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:32,719 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:32,719 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:32,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:32,729 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:32,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 06:03:32,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:32,739 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:32,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 06:03:32,752 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:32,754 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.954sec 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36535,1675922611690-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:32,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36535,1675922611690-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:32,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:32,793 DEBUG [Listener at localhost/37973] zookeeper.ReadOnlyZKClient(139): Connect 0x2cae895e to 127.0.0.1:50565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:32,800 DEBUG [Listener at localhost/37973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8e7ea2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:32,801 DEBUG [hconnection-0x69e1d3b8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:32,802 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:32,803 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:32,804 DEBUG [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:32,804 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:32,804 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:32,806 DEBUG [Listener at localhost/37973] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:32,807 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:32,808 INFO [Listener at localhost/37973] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:32,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:32,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:32,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:51116 deadline: 1675922672808, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:32,809 INFO [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 06:03:32,809 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:32,809 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:32,811 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:32,813 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:32,813 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-09 06:03:32,813 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:32,813 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:32,813 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:32,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:32,815 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:32,815 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 empty. 2023-02-09 06:03:32,816 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:32,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 06:03:32,831 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:32,832 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 23019bab67cbed3a986f6efb90b090b9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 23019bab67cbed3a986f6efb90b090b9, disabling compactions & flushes 2023-02-09 06:03:32,843 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. after waiting 0 ms 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:32,843 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:32,843 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 23019bab67cbed3a986f6efb90b090b9: Waiting for close lock at 1675922612843Disabling compacts and flushes for region at 1675922612843Disabling writes for close at 1675922612843Writing region close event to WAL at 1675922612843Closed at 1675922612843 2023-02-09 06:03:32,845 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:32,846 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675922612846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922612846"}]},"ts":"1675922612846"} 2023-02-09 06:03:32,848 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:32,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:32,848 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922612848"}]},"ts":"1675922612848"} 2023-02-09 06:03:32,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-09 06:03:32,852 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:32,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:32,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:32,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:32,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, ASSIGN}] 2023-02-09 06:03:32,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, ASSIGN 2023-02-09 06:03:32,856 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39503,1675922611775; forceNewPlan=false, retain=false 2023-02-09 06:03:32,914 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:32,915 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:32,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:33,006 INFO [jenkins-hbase4:36535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:33,007 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=23019bab67cbed3a986f6efb90b090b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675922613007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922613007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922613007"}]},"ts":"1675922613007"} 2023-02-09 06:03:33,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 23019bab67cbed3a986f6efb90b090b9, server=jenkins-hbase4.apache.org,39503,1675922611775}] 2023-02-09 06:03:33,067 INFO [RS:0;jenkins-hbase4:36957] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36957%2C1675922611743, suffix=, logDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,36957,1675922611743, archiveDir=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs, maxLogs=32 2023-02-09 06:03:33,082 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK] 2023-02-09 06:03:33,082 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK] 2023-02-09 06:03:33,084 INFO [RS:0;jenkins-hbase4:36957] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/WALs/jenkins-hbase4.apache.org,36957,1675922611743/jenkins-hbase4.apache.org%2C36957%2C1675922611743.1675922613068 2023-02-09 06:03:33,084 DEBUG [RS:0;jenkins-hbase4:36957] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33649,DS-48d39df5-42b8-4d9a-9803-f6b086189474,DISK], DatanodeInfoWithStorage[127.0.0.1:45609,DS-cb1456ac-0fb6-42d4-a53f-f012f4fca689,DISK]] 2023-02-09 06:03:33,116 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,116 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:33,149 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 06:03:33,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 23019bab67cbed3a986f6efb90b090b9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:33,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:33,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,169 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,170 DEBUG [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1 2023-02-09 06:03:33,171 DEBUG [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1 2023-02-09 06:03:33,171 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23019bab67cbed3a986f6efb90b090b9 columnFamilyName f1 2023-02-09 06:03:33,171 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] regionserver.HStore(310): Store=23019bab67cbed3a986f6efb90b090b9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:33,172 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,173 DEBUG [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2 2023-02-09 06:03:33,173 DEBUG [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2 2023-02-09 06:03:33,173 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23019bab67cbed3a986f6efb90b090b9 columnFamilyName f2 2023-02-09 06:03:33,173 INFO [StoreOpener-23019bab67cbed3a986f6efb90b090b9-1] regionserver.HStore(310): Store=23019bab67cbed3a986f6efb90b090b9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:33,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:33,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:33,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:33,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 23019bab67cbed3a986f6efb90b090b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58825008, jitterRate=-0.12343907356262207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:33,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 23019bab67cbed3a986f6efb90b090b9: Running coprocessor pre-open hook at 1675922613168Writing region info on filesystem at 1675922613168Initializing all the Stores at 1675922613169 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922613169Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922613169Cleaning up temporary data from old regions at 1675922613177 (+8 ms)Cleaning up detritus from prior splits at 1675922613178 (+1 ms)Running coprocessor post-open hooks at 1675922613186 (+8 ms)Region opened successfully at 1675922613186 2023-02-09 06:03:33,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9., pid=12, masterSystemTime=1675922613161 2023-02-09 06:03:33,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=23019bab67cbed3a986f6efb90b090b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675922613191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922613191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922613191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922613191"}]},"ts":"1675922613191"} 2023-02-09 06:03:33,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 06:03:33,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 23019bab67cbed3a986f6efb90b090b9, server=jenkins-hbase4.apache.org,39503,1675922611775 in 185 msec 2023-02-09 06:03:33,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 06:03:33,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, ASSIGN in 343 msec 2023-02-09 06:03:33,199 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:33,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922613199"}]},"ts":"1675922613199"} 2023-02-09 06:03:33,200 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-09 06:03:33,202 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:33,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 391 msec 2023-02-09 06:03:33,417 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,418 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:33,419 INFO [Listener at localhost/37973] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-09 06:03:33,419 DEBUG [Listener at localhost/37973] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-09 06:03:33,419 INFO [Listener at localhost/37973] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:33,421 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-09 06:03:33,421 INFO [Listener at localhost/37973] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:33,422 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-09 06:03:33,422 INFO [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:33,457 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,536 INFO [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:33,536 INFO [Listener at localhost/37973] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:33,536 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,536 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 06:03:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922613537 (current time:1675922613537). 2023-02-09 06:03:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:33,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] zookeeper.ReadOnlyZKClient(139): Connect 0x2e303b76 to 127.0.0.1:50565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49ac0e64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:33,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:33,543 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:33,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e303b76 to 127.0.0.1:50565 2023-02-09 06:03:33,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 06:03:33,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 06:03:33,548 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 06:03:33,549 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675923213549 2023-02-09 06:03:33,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 06:03:33,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:33,550 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:33,551 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 06:03:33,551 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:33,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 06:03:33,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-09 06:03:33,552 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 06:03:33,553 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675923213553 2023-02-09 06:03:33,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 06:03:33,560 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 06:03:33,560 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:33,560 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 06:03:33,561 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 06:03:33,561 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,561 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,562 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:33,562 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:33,562 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:33,563 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,563 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 06:03:33,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 06:03:33,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 06:03:33,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 06:03:33,564 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 06:03:33,564 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:33,564 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36957,1675922611743' joining acquired barrier for procedure (foo) in zk 2023-02-09 06:03:33,565 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39503,1675922611775' joining acquired barrier for procedure (foo) in zk 2023-02-09 06:03:33,566 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,567 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,566 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:33,567 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,567 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,567 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:33,567 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:33,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39503,1675922611775' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 06:03:33,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49a32458[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:33,568 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 06:03:33,569 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,570 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 06:03:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 06:03:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 06:03:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36957,1675922611743' in zk 2023-02-09 06:03:33,571 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,571 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 06:03:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:33,571 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,571 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. started... 2023-02-09 06:03:33,571 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 23019bab67cbed3a986f6efb90b090b9 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 06:03:33,572 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 06:03:33,572 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:33,572 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 06:03:33,584 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f1/f7681bae2d684721897a933b0532469f 2023-02-09 06:03:33,599 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f2/a39cf8f16e3544cda7981bfb715be0f0 2023-02-09 06:03:33,603 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f1/f7681bae2d684721897a933b0532469f as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f 2023-02-09 06:03:33,607 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:33,608 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f2/a39cf8f16e3544cda7981bfb715be0f0 as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0 2023-02-09 06:03:33,612 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:33,613 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 23019bab67cbed3a986f6efb90b090b9 in 42ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:33,613 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 06:03:33,613 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 23019bab67cbed3a986f6efb90b090b9: 2023-02-09 06:03:33,613 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.' region-info for snapshot=foo 2023-02-09 06:03:33,613 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:33,613 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f] hfiles 2023-02-09 06:03:33,614 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f for snapshot=foo 2023-02-09 06:03:33,614 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0] hfiles 2023-02-09 06:03:33,614 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0 for snapshot=foo 2023-02-09 06:03:33,621 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. completed. 2023-02-09 06:03:33,621 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 06:03:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 06:03:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 06:03:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39503,1675922611775' in zk 2023-02-09 06:03:33,623 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,623 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 06:03:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:33,623 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:33,624 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 06:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,39503,1675922611775': 2023-02-09 06:03:33,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39503,1675922611775' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 06:03:33,626 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 06:03:33,627 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:33,627 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:33,627 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 06:03:33,627 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:33,628 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:33,628 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:33,628 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,628 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:33,629 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:33,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,629 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,631 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,631 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 06:03:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,637 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:33,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 06:03:33,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:33,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:33,637 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:33,638 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,638 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:33,638 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 06:03:33,638 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 06:03:33,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:33,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:33,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:33,651 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:33,651 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/.tmp/foo to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/foo 2023-02-09 06:03:33,651 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 06:03:33,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:33,653 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:33,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-09 06:03:33,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:33,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.hbase-snapshot/.tmp/foo 2023-02-09 06:03:33,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675922613549Consolidate snapshot: foo at 1675922613637 (+88 ms)Loading Region manifests for foo at 1675922613637Writing data manifest for foo at 1675922613640 (+3 ms)Verifying snapshot: foo at 1675922613645 (+5 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675922613668 (+23 ms) 2023-02-09 06:03:33,670 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 06:03:33,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 120 msec 2023-02-09 06:03:33,853 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:33,853 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,853 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 06:03:33,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:33,854 INFO [Listener at localhost/37973] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:33,854 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:33,854 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:33,858 INFO [Listener at localhost/37973] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:33,863 INFO [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:33,951 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,032 INFO [Listener at localhost/37973] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:34,036 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,036 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:34,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,039 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 06:03:34,039 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:34,040 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-09 06:03:34,040 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-09 06:03:34,041 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,041 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,042 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:34,042 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:34,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:34,042 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:34,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:34,043 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,043 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 06:03:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 06:03:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 06:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 06:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 06:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36957,1675922611743' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 06:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 06:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:34,046 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,046 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. started... 2023-02-09 06:03:34,046 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 23019bab67cbed3a986f6efb90b090b9 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 06:03:34,047 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,047 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,047 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:34,068 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f1/a8c5faeff48e4252b93ea96c98d26c83 2023-02-09 06:03:34,086 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f2/252e89c502774d10a4336efde9a2460f 2023-02-09 06:03:34,090 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f1/a8c5faeff48e4252b93ea96c98d26c83 as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/a8c5faeff48e4252b93ea96c98d26c83 2023-02-09 06:03:34,093 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/a8c5faeff48e4252b93ea96c98d26c83, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:34,094 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/.tmp/f2/252e89c502774d10a4336efde9a2460f as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/252e89c502774d10a4336efde9a2460f 2023-02-09 06:03:34,097 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/252e89c502774d10a4336efde9a2460f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:34,098 INFO [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 23019bab67cbed3a986f6efb90b090b9 in 52ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:34,099 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 23019bab67cbed3a986f6efb90b090b9: 2023-02-09 06:03:34,099 DEBUG [rs(jenkins-hbase4.apache.org,39503,1675922611775)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 06:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 06:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 06:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39503,1675922611775' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 06:03:34,101 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,101 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:34,101 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,102 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:34,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39503,1675922611775' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-09 06:03:34,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d9ca9b4[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:34,103 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-09 06:03:34,103 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,106 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,106 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 06:03:34,107 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,107 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,36957,1675922611743' in zk 2023-02-09 06:03:34,107 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,39503,1675922611775' in zk 2023-02-09 06:03:34,108 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,108 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 06:03:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:34,108 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 06:03:34,108 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:34,108 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:34,109 DEBUG [member: 'jenkins-hbase4.apache.org,39503,1675922611775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 06:03:34,109 DEBUG [member: 'jenkins-hbase4.apache.org,36957,1675922611743' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 06:03:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,39503,1675922611775': 2023-02-09 06:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39503,1675922611775' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-09 06:03:34,111 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-09 06:03:34,111 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:34,111 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:34,111 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,112 INFO [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:34,117 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:34,117 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:34,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:34,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,117 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:34,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:34,118 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,118 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:34,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,120 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:34,120 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,123 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 06:03:34,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:34,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:34,123 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,123 DEBUG [(jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:34,124 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:34,124 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:34,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:34,124 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:34,124 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:34,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:34,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:34,224 DEBUG [Listener at localhost/37973] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:34,224 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,224 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:34,230 INFO [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675922613537 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:34,230 DEBUG [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34319/user/jenkins/test-data/ae34758b-39a6-9070-e36e-2c751758edf4/foo/f7a80d86-1c54-4875-90c7-4db725a08b87/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,230 INFO [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(239): region to add: 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:34,230 INFO [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(585): clone region=23019bab67cbed3a986f6efb90b090b9 as 23019bab67cbed3a986f6efb90b090b9 in snapshot foo 2023-02-09 06:03:34,231 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 23019bab67cbed3a986f6efb90b090b9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34319/user/jenkins/test-data/ae34758b-39a6-9070-e36e-2c751758edf4/foo/f7a80d86-1c54-4875-90c7-4db725a08b87 2023-02-09 06:03:34,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:34,237 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f7681bae2d684721897a933b0532469f from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,239 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a39cf8f16e3544cda7981bfb715be0f0 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 23019bab67cbed3a986f6efb90b090b9, disabling compactions & flushes 2023-02-09 06:03:34,241 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. after waiting 0 ms 2023-02-09 06:03:34,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,241 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 23019bab67cbed3a986f6efb90b090b9: Waiting for close lock at 1675922614241Disabling compacts and flushes for region at 1675922614241Disabling writes for close at 1675922614241Writing region close event to WAL at 1675922614241Closed at 1675922614241 2023-02-09 06:03:34,244 INFO [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675922613537 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:34,244 DEBUG [Listener at localhost/37973] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34319/user/jenkins/test-data/ae34758b-39a6-9070-e36e-2c751758edf4/foo/f7a80d86-1c54-4875-90c7-4db725a08b87 2023-02-09 06:03:34,244 DEBUG [Listener at localhost/37973] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34319/user/jenkins/test-data/ae34758b-39a6-9070-e36e-2c751758edf4/foo/f7a80d86-1c54-4875-90c7-4db725a08b87 2023-02-09 06:03:34,244 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:34,245 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:34,245 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-09 06:03:34,246 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |----------23019bab67cbed3a986f6efb90b090b9/ 2023-02-09 06:03:34,246 DEBUG [Listener at localhost/37973] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:34,246 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:34,246 DEBUG [Listener at localhost/37973] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=23019bab67cbed3a986f6efb90b090b9-f7681bae2d684721897a933b0532469f 2023-02-09 06:03:34,246 DEBUG [Listener at localhost/37973] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:34,247 DEBUG [Listener at localhost/37973] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=23019bab67cbed3a986f6efb90b090b9-a39cf8f16e3544cda7981bfb715be0f0 hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/a8c5faeff48e4252b93ea96c98d26c83 hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/252e89c502774d10a4336efde9a2460f hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0 2023-02-09 06:03:34,252 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,252 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 06:03:34,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 06:03:34,255 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,256 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,256 INFO [Listener at localhost/37973] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,256 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,259 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,259 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922614260"}]},"ts":"1675922614260"} 2023-02-09 06:03:34,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:34,261 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-09 06:03:34,263 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-09 06:03:34,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, UNASSIGN}] 2023-02-09 06:03:34,266 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, UNASSIGN 2023-02-09 06:03:34,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=23019bab67cbed3a986f6efb90b090b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,266 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675922614266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922614266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922614266"}]},"ts":"1675922614266"} 2023-02-09 06:03:34,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 23019bab67cbed3a986f6efb90b090b9, server=jenkins-hbase4.apache.org,39503,1675922611775}] 2023-02-09 06:03:34,360 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,360 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:34,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:34,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 23019bab67cbed3a986f6efb90b090b9, disabling compactions & flushes 2023-02-09 06:03:34,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. after waiting 0 ms 2023-02-09 06:03:34,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:34,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9. 2023-02-09 06:03:34,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 23019bab67cbed3a986f6efb90b090b9: Waiting for close lock at 1675922614420Running coprocessor pre-close hooks at 1675922614420Disabling compacts and flushes for region at 1675922614420Disabling writes for close at 1675922614420Writing region close event to WAL at 1675922614420Running coprocessor post-close hooks at 1675922614424 (+4 ms)Closed at 1675922614425 (+1 ms) 2023-02-09 06:03:34,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:34,426 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=23019bab67cbed3a986f6efb90b090b9, regionState=CLOSED 2023-02-09 06:03:34,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675922614426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922614426"}]},"ts":"1675922614426"} 2023-02-09 06:03:34,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 06:03:34,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 23019bab67cbed3a986f6efb90b090b9, server=jenkins-hbase4.apache.org,39503,1675922611775 in 160 msec 2023-02-09 06:03:34,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 06:03:34,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=23019bab67cbed3a986f6efb90b090b9, UNASSIGN in 165 msec 2023-02-09 06:03:34,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922614430"}]},"ts":"1675922614430"} 2023-02-09 06:03:34,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-09 06:03:34,433 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-09 06:03:34,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 177 msec 2023-02-09 06:03:34,562 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,562 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:34,563 INFO [Listener at localhost/37973] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-09 06:03:34,563 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,564 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,564 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,566 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,566 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:34,569 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:34,571 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1, FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2, FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/recovered.edits] 2023-02-09 06:03:34,574 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/a8c5faeff48e4252b93ea96c98d26c83 to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/a8c5faeff48e4252b93ea96c98d26c83 2023-02-09 06:03:34,575 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f1/f7681bae2d684721897a933b0532469f 2023-02-09 06:03:34,577 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/252e89c502774d10a4336efde9a2460f to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/252e89c502774d10a4336efde9a2460f 2023-02-09 06:03:34,578 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0 to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/f2/a39cf8f16e3544cda7981bfb715be0f0 2023-02-09 06:03:34,580 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/recovered.edits/12.seqid to hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9/recovered.edits/12.seqid 2023-02-09 06:03:34,581 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/23019bab67cbed3a986f6efb90b090b9 2023-02-09 06:03:34,581 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 06:03:34,582 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,584 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-09 06:03:34,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-09 06:03:34,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-09 06:03:34,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922614588"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:34,589 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 06:03:34,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 23019bab67cbed3a986f6efb90b090b9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675922612811.23019bab67cbed3a986f6efb90b090b9.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 06:03:34,590 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-09 06:03:34,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922614590"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:34,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-09 06:03:34,592 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 06:03:34,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 28 msec 2023-02-09 06:03:34,667 INFO [Listener at localhost/37973] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:34,668 INFO [Listener at localhost/37973] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:34,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:34,669 INFO [Listener at localhost/37973] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-09 06:03:34,669 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:34,669 INFO [Listener at localhost/37973] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:34,669 DEBUG [Listener at localhost/37973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cae895e to 127.0.0.1:50565 2023-02-09 06:03:34,669 DEBUG [Listener at localhost/37973] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,669 DEBUG [Listener at localhost/37973] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:34,669 DEBUG [Listener at localhost/37973] util.JVMClusterUtil(257): Found active master hash=972592923, stopped=false 2023-02-09 06:03:34,669 INFO [Listener at localhost/37973] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:34,672 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:34,672 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:34,672 INFO [Listener at localhost/37973] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:34,672 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:34,672 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:34,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:34,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:34,674 DEBUG [Listener at localhost/37973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14795e41 to 127.0.0.1:50565 2023-02-09 06:03:34,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:34,674 DEBUG [Listener at localhost/37973] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,674 INFO [Listener at localhost/37973] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36957,1675922611743' ***** 2023-02-09 06:03:34,674 INFO [Listener at localhost/37973] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:34,675 INFO [Listener at localhost/37973] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39503,1675922611775' ***** 2023-02-09 06:03:34,675 INFO [Listener at localhost/37973] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:34,675 INFO [RS:0;jenkins-hbase4:36957] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:34,675 INFO [RS:1;jenkins-hbase4:39503] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:34,675 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:34,675 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:34,675 INFO [RS:1;jenkins-hbase4:39503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:34,675 INFO [RS:0;jenkins-hbase4:36957] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:34,676 INFO [RS:1;jenkins-hbase4:39503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:34,676 INFO [RS:0;jenkins-hbase4:36957] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:34,677 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,677 DEBUG [RS:0;jenkins-hbase4:36957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40b23252 to 127.0.0.1:50565 2023-02-09 06:03:34,677 DEBUG [RS:0;jenkins-hbase4:36957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,677 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36957,1675922611743; all regions closed. 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(3304): Received CLOSE for da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,677 DEBUG [RS:1;jenkins-hbase4:39503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54594bb9 to 127.0.0.1:50565 2023-02-09 06:03:34,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da397822ed2d06c9dd5c2b3009b09d3c, disabling compactions & flushes 2023-02-09 06:03:34,677 DEBUG [RS:1;jenkins-hbase4:39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:34,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:34,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. after waiting 0 ms 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:34,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:34,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing da397822ed2d06c9dd5c2b3009b09d3c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:34,677 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 06:03:34,677 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, da397822ed2d06c9dd5c2b3009b09d3c=hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c.} 2023-02-09 06:03:34,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:34,678 DEBUG [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1505): Waiting on 1588230740, da397822ed2d06c9dd5c2b3009b09d3c 2023-02-09 06:03:34,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:34,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:34,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:34,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:34,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-09 06:03:34,681 DEBUG [RS:0;jenkins-hbase4:36957] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs 2023-02-09 06:03:34,681 INFO [RS:0;jenkins-hbase4:36957] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36957%2C1675922611743:(num 1675922613068) 2023-02-09 06:03:34,681 DEBUG [RS:0;jenkins-hbase4:36957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,682 INFO [RS:0;jenkins-hbase4:36957] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:34,682 INFO [RS:0;jenkins-hbase4:36957] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:34,682 INFO [RS:0;jenkins-hbase4:36957] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:34,682 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:34,682 INFO [RS:0;jenkins-hbase4:36957] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:34,682 INFO [RS:0;jenkins-hbase4:36957] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:34,683 INFO [RS:0;jenkins-hbase4:36957] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36957 2023-02-09 06:03:34,685 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,685 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36957,1675922611743 2023-02-09 06:03:34,685 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:34,685 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:34,685 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45eaef1d rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:34,686 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:34,686 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@271940ec rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:34,686 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36957,1675922611743] 2023-02-09 06:03:34,686 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36957,1675922611743; numProcessing=1 2023-02-09 06:03:34,688 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36957,1675922611743 already deleted, retry=false 2023-02-09 06:03:34,688 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36957,1675922611743 expired; onlineServers=1 2023-02-09 06:03:34,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/.tmp/info/ca0c296a39d840808151a4611d6f8c4a 2023-02-09 06:03:34,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/info/25a855c0054249bcb092809fa4a0dbe4 2023-02-09 06:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/.tmp/info/ca0c296a39d840808151a4611d6f8c4a as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/info/ca0c296a39d840808151a4611d6f8c4a 2023-02-09 06:03:34,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25a855c0054249bcb092809fa4a0dbe4 2023-02-09 06:03:34,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/info/ca0c296a39d840808151a4611d6f8c4a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:34,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for da397822ed2d06c9dd5c2b3009b09d3c in 31ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:34,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/namespace/da397822ed2d06c9dd5c2b3009b09d3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:34,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/rep_barrier/3f321ddc6c854d7db95551995b585a63 2023-02-09 06:03:34,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:34,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da397822ed2d06c9dd5c2b3009b09d3c: Waiting for close lock at 1675922614677Running coprocessor pre-close hooks at 1675922614677Disabling compacts and flushes for region at 1675922614677Disabling writes for close at 1675922614677Obtaining lock to block concurrent updates at 1675922614677Preparing flush snapshotting stores in da397822ed2d06c9dd5c2b3009b09d3c at 1675922614677Finished memstore snapshotting hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922614678 (+1 ms)Flushing stores of hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. at 1675922614679 (+1 ms)Flushing da397822ed2d06c9dd5c2b3009b09d3c/info: creating writer at 1675922614679Flushing da397822ed2d06c9dd5c2b3009b09d3c/info: appending metadata at 1675922614682 (+3 ms)Flushing da397822ed2d06c9dd5c2b3009b09d3c/info: closing flushed file at 1675922614682Flushing da397822ed2d06c9dd5c2b3009b09d3c/info: reopening flushed file at 1675922614704 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for da397822ed2d06c9dd5c2b3009b09d3c in 31ms, sequenceid=6, compaction requested=false at 1675922614708 (+4 ms)Writing region close event to WAL at 1675922614708Running coprocessor post-close hooks at 1675922614712 (+4 ms)Closed at 1675922614713 (+1 ms) 2023-02-09 06:03:34,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922612315.da397822ed2d06c9dd5c2b3009b09d3c. 2023-02-09 06:03:34,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f321ddc6c854d7db95551995b585a63 2023-02-09 06:03:34,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/table/443cac3d58fa468889db444c3b0cc32d 2023-02-09 06:03:34,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 443cac3d58fa468889db444c3b0cc32d 2023-02-09 06:03:34,726 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/info/25a855c0054249bcb092809fa4a0dbe4 as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/info/25a855c0054249bcb092809fa4a0dbe4 2023-02-09 06:03:34,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25a855c0054249bcb092809fa4a0dbe4 2023-02-09 06:03:34,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/info/25a855c0054249bcb092809fa4a0dbe4, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 06:03:34,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/rep_barrier/3f321ddc6c854d7db95551995b585a63 as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/rep_barrier/3f321ddc6c854d7db95551995b585a63 2023-02-09 06:03:34,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f321ddc6c854d7db95551995b585a63 2023-02-09 06:03:34,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/rep_barrier/3f321ddc6c854d7db95551995b585a63, entries=1, sequenceid=21, filesize=5.1 K 2023-02-09 06:03:34,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/.tmp/table/443cac3d58fa468889db444c3b0cc32d as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/table/443cac3d58fa468889db444c3b0cc32d 2023-02-09 06:03:34,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 443cac3d58fa468889db444c3b0cc32d 2023-02-09 06:03:34,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/table/443cac3d58fa468889db444c3b0cc32d, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 06:03:34,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-09 06:03:34,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 06:03:34,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:34,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:34,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922614678Running coprocessor pre-close hooks at 1675922614678Disabling compacts and flushes for region at 1675922614678Disabling writes for close at 1675922614678Obtaining lock to block concurrent updates at 1675922614678Preparing flush snapshotting stores in 1588230740 at 1675922614678Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675922614678Flushing stores of hbase:meta,,1.1588230740 at 1675922614679 (+1 ms)Flushing 1588230740/info: creating writer at 1675922614679Flushing 1588230740/info: appending metadata at 1675922614682 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675922614682Flushing 1588230740/rep_barrier: creating writer at 1675922614704 (+22 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922614706 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922614706Flushing 1588230740/table: creating writer at 1675922614716 (+10 ms)Flushing 1588230740/table: appending metadata at 1675922614717 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675922614718 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675922614726 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922614730 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675922614734 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false at 1675922614738 (+4 ms)Writing region close event to WAL at 1675922614739 (+1 ms)Running coprocessor post-close hooks at 1675922614742 (+3 ms)Closed at 1675922614743 (+1 ms) 2023-02-09 06:03:34,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:34,744 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:34,744 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:34,871 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:34,871 INFO [RS:0;jenkins-hbase4:36957] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36957,1675922611743; zookeeper connection closed. 2023-02-09 06:03:34,871 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f3d3a7d rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:34,871 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:36957-0x10037ad879d0001, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:34,871 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f1d399a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f1d399a 2023-02-09 06:03:34,871 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@98b283a rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:34,878 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39503,1675922611775; all regions closed. 2023-02-09 06:03:34,882 DEBUG [RS:1;jenkins-hbase4:39503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs 2023-02-09 06:03:34,882 INFO [RS:1;jenkins-hbase4:39503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39503%2C1675922611775.meta:.meta(num 1675922612264) 2023-02-09 06:03:34,888 DEBUG [RS:1;jenkins-hbase4:39503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/oldWALs 2023-02-09 06:03:34,888 INFO [RS:1;jenkins-hbase4:39503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39503%2C1675922611775:(num 1675922612657) 2023-02-09 06:03:34,888 DEBUG [RS:1;jenkins-hbase4:39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,888 INFO [RS:1;jenkins-hbase4:39503] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:34,888 INFO [RS:1;jenkins-hbase4:39503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:34,889 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:34,889 INFO [RS:1;jenkins-hbase4:39503] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39503 2023-02-09 06:03:34,891 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39503,1675922611775 2023-02-09 06:03:34,891 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:34,891 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b81bee0 rejected from java.util.concurrent.ThreadPoolExecutor@6fbe2748[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:34,894 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39503,1675922611775] 2023-02-09 06:03:34,894 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39503,1675922611775; numProcessing=2 2023-02-09 06:03:34,895 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39503,1675922611775 already deleted, retry=false 2023-02-09 06:03:34,895 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39503,1675922611775 expired; onlineServers=0 2023-02-09 06:03:34,895 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36535,1675922611690' ***** 2023-02-09 06:03:34,895 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:34,896 DEBUG [M:0;jenkins-hbase4:36535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dc704fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:34,896 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36535,1675922611690 2023-02-09 06:03:34,896 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36535,1675922611690; all regions closed. 2023-02-09 06:03:34,896 DEBUG [M:0;jenkins-hbase4:36535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:34,896 DEBUG [M:0;jenkins-hbase4:36535] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:34,896 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:34,896 DEBUG [M:0;jenkins-hbase4:36535] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:34,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922611919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922611919,5,FailOnTimeoutGroup] 2023-02-09 06:03:34,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922611919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922611919,5,FailOnTimeoutGroup] 2023-02-09 06:03:34,896 INFO [M:0;jenkins-hbase4:36535] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:34,898 INFO [M:0;jenkins-hbase4:36535] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:34,898 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:34,898 INFO [M:0;jenkins-hbase4:36535] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:34,898 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:34,898 DEBUG [M:0;jenkins-hbase4:36535] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:34,898 INFO [M:0;jenkins-hbase4:36535] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:34,899 ERROR [M:0;jenkins-hbase4:36535] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:34,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:34,899 INFO [M:0;jenkins-hbase4:36535] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:34,899 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:34,899 DEBUG [M:0;jenkins-hbase4:36535] zookeeper.ZKUtil(398): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:34,899 WARN [M:0;jenkins-hbase4:36535] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:34,899 INFO [M:0;jenkins-hbase4:36535] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:34,900 INFO [M:0;jenkins-hbase4:36535] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:34,900 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:34,900 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:34,900 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:34,900 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:34,900 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:34,900 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.66 KB heapSize=67.62 KB 2023-02-09 06:03:34,914 INFO [M:0;jenkins-hbase4:36535] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a354915f30cc408faa3d3d99ff3e0dfa 2023-02-09 06:03:34,917 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a354915f30cc408faa3d3d99ff3e0dfa as hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a354915f30cc408faa3d3d99ff3e0dfa 2023-02-09 06:03:34,921 INFO [M:0;jenkins-hbase4:36535] regionserver.HStore(1080): Added hdfs://localhost:34319/user/jenkins/test-data/ca1ce08b-4d2e-e4e2-119a-cc1575318118/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a354915f30cc408faa3d3d99ff3e0dfa, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 06:03:34,922 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegion(2947): Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false 2023-02-09 06:03:34,922 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:34,922 DEBUG [M:0;jenkins-hbase4:36535] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922614900Disabling compacts and flushes for region at 1675922614900Disabling writes for close at 1675922614900Obtaining lock to block concurrent updates at 1675922614900Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922614900Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58020, getHeapSize=69224, getOffHeapSize=0, getCellsCount=145 at 1675922614901 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922614902 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922614902Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922614904 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922614904Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922614918 (+14 ms)Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false at 1675922614922 (+4 ms)Writing region close event to WAL at 1675922614922Closed at 1675922614922 2023-02-09 06:03:34,925 INFO [M:0;jenkins-hbase4:36535] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:34,925 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:34,926 INFO [M:0;jenkins-hbase4:36535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36535 2023-02-09 06:03:34,927 DEBUG [M:0;jenkins-hbase4:36535] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36535,1675922611690 already deleted, retry=false 2023-02-09 06:03:35,274 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:35,274 INFO [M:0;jenkins-hbase4:36535] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36535,1675922611690; zookeeper connection closed. 2023-02-09 06:03:35,274 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51ae3af4 rejected from java.util.concurrent.ThreadPoolExecutor@5591a419[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:35,275 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): master:36535-0x10037ad879d0000, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:35,275 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@190b733 rejected from java.util.concurrent.ThreadPoolExecutor@5591a419[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:35,374 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:35,374 INFO [RS:1;jenkins-hbase4:39503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39503,1675922611775; zookeeper connection closed. 2023-02-09 06:03:35,374 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7dcc0a38 rejected from java.util.concurrent.ThreadPoolExecutor@6fbe2748[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:35,375 DEBUG [Listener at localhost/37973-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10037ad879d0002, quorum=127.0.0.1:50565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:35,375 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@244bd133] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@244bd133 2023-02-09 06:03:35,375 ERROR [Listener at localhost/37973-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c63d9b rejected from java.util.concurrent.ThreadPoolExecutor@6fbe2748[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:35,375 INFO [Listener at localhost/37973] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:35,375 WARN [Listener at localhost/37973] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:35,380 INFO [Listener at localhost/37973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:35,484 WARN [BP-1179853680-172.31.14.131-1675922611114 heartbeating to localhost/127.0.0.1:34319] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:35,484 WARN [BP-1179853680-172.31.14.131-1675922611114 heartbeating to localhost/127.0.0.1:34319] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1179853680-172.31.14.131-1675922611114 (Datanode Uuid d5d02f8f-b99b-49db-9d68-e73042cf7a94) service to localhost/127.0.0.1:34319 2023-02-09 06:03:35,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/dfs/data/data3/current/BP-1179853680-172.31.14.131-1675922611114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:35,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/dfs/data/data4/current/BP-1179853680-172.31.14.131-1675922611114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:35,486 WARN [Listener at localhost/37973] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:35,491 INFO [Listener at localhost/37973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:35,594 WARN [BP-1179853680-172.31.14.131-1675922611114 heartbeating to localhost/127.0.0.1:34319] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:35,594 WARN [BP-1179853680-172.31.14.131-1675922611114 heartbeating to localhost/127.0.0.1:34319] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1179853680-172.31.14.131-1675922611114 (Datanode Uuid 03d666aa-58e5-4d36-999e-191ca7c6efad) service to localhost/127.0.0.1:34319 2023-02-09 06:03:35,595 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/dfs/data/data1/current/BP-1179853680-172.31.14.131-1675922611114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:35,595 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/cluster_1435c965-0ff1-27ef-babd-9ec76792bb0f/dfs/data/data2/current/BP-1179853680-172.31.14.131-1675922611114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:35,604 INFO [Listener at localhost/37973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:35,717 INFO [Listener at localhost/37973] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:35,735 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:35,747 INFO [Listener at localhost/37973] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=271 (was 252) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:34319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37973 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34319 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36535,1675922611690)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:34319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34319 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34319 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:34319 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 663), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 275) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3353 (was 3434) 2023-02-09 06:03:35,757 INFO [Listener at localhost/37973] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=271, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=166, AvailableMemoryMB=3352 2023-02-09 06:03:35,767 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.log.dir so I do NOT create it in target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1 2023-02-09 06:03:35,767 WARN [Listener at localhost/37973] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 06:03:35,767 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.tmp.dir so I do NOT create it in target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1 2023-02-09 06:03:35,767 WARN [Listener at localhost/37973] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6a84df6-1e96-63c6-bd35-f9053b89ac42/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 06:03:35,767 DEBUG [Listener at localhost/37973] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1 2023-02-09 06:03:35,767 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 06:03:35,767 INFO [Listener at localhost/37973] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374, deleteOnExit=true 2023-02-09 06:03:35,767 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/test.cache.data in system properties and HBase conf 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/hadoop.log.dir in system properties and HBase conf 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 06:03:35,768 DEBUG [Listener at localhost/37973] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 06:03:35,768 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/nfs.dump.dir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/java.io.tmpdir in system properties and HBase conf 2023-02-09 06:03:35,769 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 06:03:35,770 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 06:03:35,770 INFO [Listener at localhost/37973] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 06:03:35,773 WARN [Listener at localhost/37973] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:35,774 WARN [Listener at localhost/37973] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:35,815 WARN [Listener at localhost/37973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:35,816 INFO [Listener at localhost/37973] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:35,820 INFO [Listener at localhost/37973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/java.io.tmpdir/Jetty_localhost_45111_hdfs____.7mqzxi/webapp 2023-02-09 06:03:35,912 INFO [Listener at localhost/37973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45111 2023-02-09 06:03:35,917 WARN [Listener at localhost/37973] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 06:03:35,917 WARN [Listener at localhost/37973] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 06:03:35,958 WARN [Listener at localhost/44309] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:35,975 WARN [Listener at localhost/44309] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:35,976 WARN [Listener at localhost/44309] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:35,978 INFO [Listener at localhost/44309] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:35,984 INFO [Listener at localhost/44309] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/java.io.tmpdir/Jetty_localhost_40331_datanode____.d1364k/webapp 2023-02-09 06:03:36,078 INFO [Listener at localhost/44309] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40331 2023-02-09 06:03:36,088 WARN [Listener at localhost/37927] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:36,107 WARN [Listener at localhost/37927] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 06:03:36,109 WARN [Listener at localhost/37927] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 06:03:36,111 INFO [Listener at localhost/37927] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 06:03:36,113 INFO [Listener at localhost/37927] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/java.io.tmpdir/Jetty_localhost_36183_datanode____pnaya8/webapp 2023-02-09 06:03:36,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7eb575bdb97d022e: Processing first storage report for DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef from datanode 4ce7a7f2-f149-4c94-aeb5-251a707e1a81 2023-02-09 06:03:36,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7eb575bdb97d022e: from storage DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef node DatanodeRegistration(127.0.0.1:36411, datanodeUuid=4ce7a7f2-f149-4c94-aeb5-251a707e1a81, infoPort=44061, infoSecurePort=0, ipcPort=37927, storageInfo=lv=-57;cid=testClusterID;nsid=1434714780;c=1675922615776), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:36,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7eb575bdb97d022e: Processing first storage report for DS-f10798a1-6de1-466b-9afb-df4b44865e30 from datanode 4ce7a7f2-f149-4c94-aeb5-251a707e1a81 2023-02-09 06:03:36,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7eb575bdb97d022e: from storage DS-f10798a1-6de1-466b-9afb-df4b44865e30 node DatanodeRegistration(127.0.0.1:36411, datanodeUuid=4ce7a7f2-f149-4c94-aeb5-251a707e1a81, infoPort=44061, infoSecurePort=0, ipcPort=37927, storageInfo=lv=-57;cid=testClusterID;nsid=1434714780;c=1675922615776), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:36,213 INFO [Listener at localhost/37927] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36183 2023-02-09 06:03:36,221 WARN [Listener at localhost/36659] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 06:03:36,312 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe561e9e807c7c7f2: Processing first storage report for DS-f7741c27-233a-4535-a884-d96d69144d2c from datanode 5f4c651c-fdcf-4262-be39-756a8a7ff004 2023-02-09 06:03:36,312 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe561e9e807c7c7f2: from storage DS-f7741c27-233a-4535-a884-d96d69144d2c node DatanodeRegistration(127.0.0.1:45797, datanodeUuid=5f4c651c-fdcf-4262-be39-756a8a7ff004, infoPort=40301, infoSecurePort=0, ipcPort=36659, storageInfo=lv=-57;cid=testClusterID;nsid=1434714780;c=1675922615776), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:36,312 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe561e9e807c7c7f2: Processing first storage report for DS-dd8232bd-1c30-4c37-be64-287355f75ebc from datanode 5f4c651c-fdcf-4262-be39-756a8a7ff004 2023-02-09 06:03:36,312 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe561e9e807c7c7f2: from storage DS-dd8232bd-1c30-4c37-be64-287355f75ebc node DatanodeRegistration(127.0.0.1:45797, datanodeUuid=5f4c651c-fdcf-4262-be39-756a8a7ff004, infoPort=40301, infoSecurePort=0, ipcPort=36659, storageInfo=lv=-57;cid=testClusterID;nsid=1434714780;c=1675922615776), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 06:03:36,329 DEBUG [Listener at localhost/36659] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1 2023-02-09 06:03:36,330 INFO [Listener at localhost/36659] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/zookeeper_0, clientPort=61212, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 06:03:36,331 INFO [Listener at localhost/36659] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61212 2023-02-09 06:03:36,332 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,333 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,346 INFO [Listener at localhost/36659] util.FSUtils(479): Created version file at hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb with version=8 2023-02-09 06:03:36,347 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,348 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,349 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/hbase-staging 2023-02-09 06:03:36,351 INFO [Listener at localhost/36659] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:36,351 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,351 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,352 INFO [Listener at localhost/36659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:36,352 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,352 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:36,352 INFO [Listener at localhost/36659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:36,352 INFO [Listener at localhost/36659] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39071 2023-02-09 06:03:36,353 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,354 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,355 INFO [Listener at localhost/36659] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39071 connecting to ZooKeeper ensemble=127.0.0.1:61212 2023-02-09 06:03:36,362 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:390710x0, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:36,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39071-0x10037ad99cf0000 connected 2023-02-09 06:03:36,377 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:36,378 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:36,378 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:36,379 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39071 2023-02-09 06:03:36,379 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39071 2023-02-09 06:03:36,379 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39071 2023-02-09 06:03:36,381 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39071 2023-02-09 06:03:36,382 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39071 2023-02-09 06:03:36,382 INFO [Listener at localhost/36659] master.HMaster(439): hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb, hbase.cluster.distributed=false 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:36,398 INFO [Listener at localhost/36659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:36,399 INFO [Listener at localhost/36659] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35495 2023-02-09 06:03:36,399 INFO [Listener at localhost/36659] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:36,400 DEBUG [Listener at localhost/36659] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:36,400 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,401 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,402 INFO [Listener at localhost/36659] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35495 connecting to ZooKeeper ensemble=127.0.0.1:61212 2023-02-09 06:03:36,404 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:354950x0, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:36,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35495-0x10037ad99cf0001 connected 2023-02-09 06:03:36,406 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:36,407 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:36,407 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:36,408 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35495 2023-02-09 06:03:36,408 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35495 2023-02-09 06:03:36,408 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35495 2023-02-09 06:03:36,409 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35495 2023-02-09 06:03:36,409 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35495 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 06:03:36,419 INFO [Listener at localhost/36659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 06:03:36,420 INFO [Listener at localhost/36659] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41387 2023-02-09 06:03:36,420 INFO [Listener at localhost/36659] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 06:03:36,422 DEBUG [Listener at localhost/36659] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:36,423 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,423 INFO [Listener at localhost/36659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,424 INFO [Listener at localhost/36659] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41387 connecting to ZooKeeper ensemble=127.0.0.1:61212 2023-02-09 06:03:36,431 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:413870x0, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 06:03:36,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41387-0x10037ad99cf0002 connected 2023-02-09 06:03:36,432 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:36,432 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:36,432 DEBUG [Listener at localhost/36659] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 06:03:36,433 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41387 2023-02-09 06:03:36,434 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41387 2023-02-09 06:03:36,436 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41387 2023-02-09 06:03:36,440 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41387 2023-02-09 06:03:36,440 DEBUG [Listener at localhost/36659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41387 2023-02-09 06:03:36,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,443 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:36,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,444 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:36,444 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:36,444 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,444 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:36,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:36,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 06:03:36,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39071,1675922616351 from backup master directory 2023-02-09 06:03:36,449 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,449 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:36,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,449 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 06:03:36,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/hbase.id with ID: 713df904-cbb3-4e5b-83ef-16e89f445c66 2023-02-09 06:03:36,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 06:03:36,474 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3cafdf8e to 127.0.0.1:61212 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:36,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d300b81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:36,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:36,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 06:03:36,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:36,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store-tmp 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:36,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:36,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:36,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922616498Disabling compacts and flushes for region at 1675922616498Disabling writes for close at 1675922616498Writing region close event to WAL at 1675922616498Closed at 1675922616498 2023-02-09 06:03:36,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/WALs/jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39071%2C1675922616351, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/WALs/jenkins-hbase4.apache.org,39071,1675922616351, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/oldWALs, maxLogs=10 2023-02-09 06:03:36,512 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK] 2023-02-09 06:03:36,512 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK] 2023-02-09 06:03:36,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/WALs/jenkins-hbase4.apache.org,39071,1675922616351/jenkins-hbase4.apache.org%2C39071%2C1675922616351.1675922616500 2023-02-09 06:03:36,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK], DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK]] 2023-02-09 06:03:36,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:36,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:36,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,515 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,516 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 06:03:36,517 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 06:03:36,517 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 06:03:36,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:36,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59469526, jitterRate=-0.11383500695228577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:36,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675922616515Initializing all the Stores at 1675922616515Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922616515Cleaning up temporary data from old regions at 1675922616518 (+3 ms)Cleaning up detritus from prior splits at 1675922616519 (+1 ms)Region opened successfully at 1675922616522 (+3 ms) 2023-02-09 06:03:36,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 06:03:36,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 06:03:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 06:03:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 06:03:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 06:03:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 06:03:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 06:03:36,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 06:03:36,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 06:03:36,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 06:03:36,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 06:03:36,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 06:03:36,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 06:03:36,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 06:03:36,543 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 06:03:36,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 06:03:36,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 06:03:36,546 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:36,546 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:36,546 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:36,546 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39071,1675922616351, sessionid=0x10037ad99cf0000, setting cluster-up flag (Was=false) 2023-02-09 06:03:36,552 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 06:03:36,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,559 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 06:03:36,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:36,565 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/.tmp 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:36,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675922646569 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 06:03:36,569 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 06:03:36,569 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 06:03:36,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 06:03:36,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 06:03:36,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 06:03:36,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 06:03:36,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 06:03:36,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 06:03:36,571 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:36,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922616571,5,FailOnTimeoutGroup] 2023-02-09 06:03:36,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922616571,5,FailOnTimeoutGroup] 2023-02-09 06:03:36,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 06:03:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,582 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:36,582 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:36,582 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb 2023-02-09 06:03:36,589 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:36,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:36,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/info 2023-02-09 06:03:36,591 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:36,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:36,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:36,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:36,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:36,594 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/table 2023-02-09 06:03:36,595 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:36,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,595 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740 2023-02-09 06:03:36,595 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740 2023-02-09 06:03:36,597 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:36,598 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:36,599 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:36,599 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74135178, jitterRate=0.1047002375125885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675922616589Initializing all the Stores at 1675922616590 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922616590Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922616590Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922616590Cleaning up temporary data from old regions at 1675922616596 (+6 ms)Cleaning up detritus from prior splits at 1675922616596Region opened successfully at 1675922616600 (+4 ms) 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:36,600 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:36,600 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:36,600 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922616600Disabling compacts and flushes for region at 1675922616600Disabling writes for close at 1675922616600Writing region close event to WAL at 1675922616600Closed at 1675922616600 2023-02-09 06:03:36,601 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 06:03:36,601 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 06:03:36,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 06:03:36,604 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 06:03:36,605 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 06:03:36,642 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(952): ClusterId : 713df904-cbb3-4e5b-83ef-16e89f445c66 2023-02-09 06:03:36,642 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(952): ClusterId : 713df904-cbb3-4e5b-83ef-16e89f445c66 2023-02-09 06:03:36,642 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:36,642 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 06:03:36,644 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:36,644 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:36,644 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 06:03:36,644 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 06:03:36,647 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:36,649 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 06:03:36,649 DEBUG [RS:0;jenkins-hbase4:35495] zookeeper.ReadOnlyZKClient(139): Connect 0x23eadaab to 127.0.0.1:61212 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:36,649 DEBUG [RS:1;jenkins-hbase4:41387] zookeeper.ReadOnlyZKClient(139): Connect 0x15431cfb to 127.0.0.1:61212 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:36,652 DEBUG [RS:1;jenkins-hbase4:41387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b84f023, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:36,652 DEBUG [RS:0;jenkins-hbase4:35495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2d20a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:36,652 DEBUG [RS:1;jenkins-hbase4:41387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbb778b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:36,652 DEBUG [RS:0;jenkins-hbase4:35495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2912b1db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:36,661 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41387 2023-02-09 06:03:36,661 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35495 2023-02-09 06:03:36,661 INFO [RS:1;jenkins-hbase4:41387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:36,661 INFO [RS:1;jenkins-hbase4:41387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:36,661 INFO [RS:0;jenkins-hbase4:35495] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 06:03:36,661 INFO [RS:0;jenkins-hbase4:35495] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 06:03:36,661 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:36,661 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 06:03:36,661 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39071,1675922616351 with isa=jenkins-hbase4.apache.org/172.31.14.131:35495, startcode=1675922616397 2023-02-09 06:03:36,661 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39071,1675922616351 with isa=jenkins-hbase4.apache.org/172.31.14.131:41387, startcode=1675922616418 2023-02-09 06:03:36,662 DEBUG [RS:0;jenkins-hbase4:35495] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:36,662 DEBUG [RS:1;jenkins-hbase4:41387] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 06:03:36,663 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34579, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:36,663 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35121, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 06:03:36,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39071] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,666 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb 2023-02-09 06:03:36,666 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44309 2023-02-09 06:03:36,666 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:36,666 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb 2023-02-09 06:03:36,666 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44309 2023-02-09 06:03:36,667 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 06:03:36,667 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:36,672 DEBUG [RS:0;jenkins-hbase4:35495] zookeeper.ZKUtil(162): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,672 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35495,1675922616397] 2023-02-09 06:03:36,672 WARN [RS:0;jenkins-hbase4:35495] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:36,672 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41387,1675922616418] 2023-02-09 06:03:36,672 INFO [RS:0;jenkins-hbase4:35495] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:36,672 DEBUG [RS:1;jenkins-hbase4:41387] zookeeper.ZKUtil(162): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,672 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,672 WARN [RS:1;jenkins-hbase4:41387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 06:03:36,672 INFO [RS:1;jenkins-hbase4:41387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:36,672 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,677 DEBUG [RS:1;jenkins-hbase4:41387] zookeeper.ZKUtil(162): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,677 DEBUG [RS:0;jenkins-hbase4:35495] zookeeper.ZKUtil(162): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,677 DEBUG [RS:1;jenkins-hbase4:41387] zookeeper.ZKUtil(162): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,677 DEBUG [RS:0;jenkins-hbase4:35495] zookeeper.ZKUtil(162): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,678 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:36,678 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 06:03:36,678 INFO [RS:1;jenkins-hbase4:41387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:36,678 INFO [RS:0;jenkins-hbase4:35495] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 06:03:36,679 INFO [RS:1;jenkins-hbase4:41387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:36,680 INFO [RS:1;jenkins-hbase4:41387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:36,680 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,682 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:36,685 INFO [RS:0;jenkins-hbase4:35495] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 06:03:36,685 INFO [RS:0;jenkins-hbase4:35495] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 06:03:36,686 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,686 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 06:03:36,686 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,688 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:36,689 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,689 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,689 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,689 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,689 DEBUG [RS:1;jenkins-hbase4:41387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,691 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,691 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,691 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,691 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,692 DEBUG [RS:0;jenkins-hbase4:35495] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 06:03:36,693 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,693 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,693 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,693 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,694 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,694 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,706 INFO [RS:1;jenkins-hbase4:41387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:36,706 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41387,1675922616418-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,711 INFO [RS:0;jenkins-hbase4:35495] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 06:03:36,711 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35495,1675922616397-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,716 INFO [RS:1;jenkins-hbase4:41387] regionserver.Replication(203): jenkins-hbase4.apache.org,41387,1675922616418 started 2023-02-09 06:03:36,716 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41387,1675922616418, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41387, sessionid=0x10037ad99cf0002 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41387,1675922616418' 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41387,1675922616418' 2023-02-09 06:03:36,716 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:36,717 DEBUG [RS:1;jenkins-hbase4:41387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:36,717 DEBUG [RS:1;jenkins-hbase4:41387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:36,717 INFO [RS:1;jenkins-hbase4:41387] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:36,717 INFO [RS:1;jenkins-hbase4:41387] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:36,727 INFO [RS:0;jenkins-hbase4:35495] regionserver.Replication(203): jenkins-hbase4.apache.org,35495,1675922616397 started 2023-02-09 06:03:36,727 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35495,1675922616397, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35495, sessionid=0x10037ad99cf0001 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35495,1675922616397' 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 06:03:36,727 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 06:03:36,728 DEBUG [RS:0;jenkins-hbase4:35495] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:36,728 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35495,1675922616397' 2023-02-09 06:03:36,728 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:36,728 DEBUG [RS:0;jenkins-hbase4:35495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:36,728 DEBUG [RS:0;jenkins-hbase4:35495] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 06:03:36,728 INFO [RS:0;jenkins-hbase4:35495] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 06:03:36,728 INFO [RS:0;jenkins-hbase4:35495] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 06:03:36,755 DEBUG [jenkins-hbase4:39071] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 06:03:36,755 DEBUG [jenkins-hbase4:39071] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:36,757 DEBUG [jenkins-hbase4:39071] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:36,757 DEBUG [jenkins-hbase4:39071] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:36,757 DEBUG [jenkins-hbase4:39071] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:36,757 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41387,1675922616418, state=OPENING 2023-02-09 06:03:36,758 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 06:03:36,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:36,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41387,1675922616418}] 2023-02-09 06:03:36,759 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:36,914 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:36,914 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:36,915 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:36,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 06:03:36,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 06:03:36,921 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41387%2C1675922616418.meta, suffix=.meta, logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,41387,1675922616418, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs, maxLogs=32 2023-02-09 06:03:36,935 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK] 2023-02-09 06:03:36,935 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK] 2023-02-09 06:03:36,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,41387,1675922616418/jenkins-hbase4.apache.org%2C41387%2C1675922616418.meta.1675922616921.meta 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK], DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK]] 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 06:03:36,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 06:03:36,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 06:03:36,938 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 06:03:36,939 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/info 2023-02-09 06:03:36,939 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/info 2023-02-09 06:03:36,939 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 06:03:36,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 06:03:36,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:36,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/rep_barrier 2023-02-09 06:03:36,941 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 06:03:36,941 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,941 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 06:03:36,942 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/table 2023-02-09 06:03:36,942 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/table 2023-02-09 06:03:36,942 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 06:03:36,942 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:36,943 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740 2023-02-09 06:03:36,944 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740 2023-02-09 06:03:36,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 06:03:36,946 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 06:03:36,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63983604, jitterRate=-0.046570003032684326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 06:03:36,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675922616937Writing region info on filesystem at 1675922616937Initializing all the Stores at 1675922616938 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922616938Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922616938Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922616938Cleaning up temporary data from old regions at 1675922616945 (+7 ms)Cleaning up detritus from prior splits at 1675922616945Running coprocessor post-open hooks at 1675922616947 (+2 ms)Region opened successfully at 1675922616947 2023-02-09 06:03:36,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675922616914 2023-02-09 06:03:36,950 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 06:03:36,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 06:03:36,951 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41387,1675922616418, state=OPEN 2023-02-09 06:03:36,952 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 06:03:36,952 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 06:03:36,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 06:03:36,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41387,1675922616418 in 193 msec 2023-02-09 06:03:36,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 06:03:36,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-09 06:03:36,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-09 06:03:36,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675922616443, completionTime=-1 2023-02-09 06:03:36,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 06:03:36,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 06:03:36,958 DEBUG [hconnection-0x6caec621-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:36,959 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:36,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 06:03:36,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675922676960 2023-02-09 06:03:36,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675922736960 2023-02-09 06:03:36,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-09 06:03:36,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39071,1675922616351-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39071,1675922616351-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39071,1675922616351-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39071, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 06:03:36,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 06:03:36,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:36,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 06:03:36,967 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 06:03:36,969 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:36,969 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:36,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:36,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e empty. 2023-02-09 06:03:36,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:36,971 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 06:03:36,983 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:36,984 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => dd5e195155894c8d7144580dc90fd47e, NAME => 'hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp 2023-02-09 06:03:36,991 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:36,992 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing dd5e195155894c8d7144580dc90fd47e, disabling compactions & flushes 2023-02-09 06:03:36,992 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:36,992 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:36,992 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. after waiting 0 ms 2023-02-09 06:03:36,992 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:36,992 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:36,992 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for dd5e195155894c8d7144580dc90fd47e: Waiting for close lock at 1675922616992Disabling compacts and flushes for region at 1675922616992Disabling writes for close at 1675922616992Writing region close event to WAL at 1675922616992Closed at 1675922616992 2023-02-09 06:03:36,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:36,994 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922616994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922616994"}]},"ts":"1675922616994"} 2023-02-09 06:03:36,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:36,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:36,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922616996"}]},"ts":"1675922616996"} 2023-02-09 06:03:36,997 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 06:03:37,000 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:37,000 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:37,000 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:37,000 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:37,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dd5e195155894c8d7144580dc90fd47e, ASSIGN}] 2023-02-09 06:03:37,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dd5e195155894c8d7144580dc90fd47e, ASSIGN 2023-02-09 06:03:37,003 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dd5e195155894c8d7144580dc90fd47e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35495,1675922616397; forceNewPlan=false, retain=false 2023-02-09 06:03:37,153 INFO [jenkins-hbase4:39071] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:37,153 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dd5e195155894c8d7144580dc90fd47e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:37,153 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922617153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922617153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922617153"}]},"ts":"1675922617153"} 2023-02-09 06:03:37,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dd5e195155894c8d7144580dc90fd47e, server=jenkins-hbase4.apache.org,35495,1675922616397}] 2023-02-09 06:03:37,307 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:37,308 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 06:03:37,309 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 06:03:37,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:37,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35495%2C1675922616397, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,35495,1675922616397, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs, maxLogs=32 2023-02-09 06:03:37,329 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK] 2023-02-09 06:03:37,330 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK] 2023-02-09 06:03:37,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,35495,1675922616397/jenkins-hbase4.apache.org%2C35495%2C1675922616397.1675922617314 2023-02-09 06:03:37,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK]] 2023-02-09 06:03:37,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dd5e195155894c8d7144580dc90fd47e, NAME => 'hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:37,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:37,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,333 INFO [StoreOpener-dd5e195155894c8d7144580dc90fd47e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,334 DEBUG [StoreOpener-dd5e195155894c8d7144580dc90fd47e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/info 2023-02-09 06:03:37,334 DEBUG [StoreOpener-dd5e195155894c8d7144580dc90fd47e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/info 2023-02-09 06:03:37,334 INFO [StoreOpener-dd5e195155894c8d7144580dc90fd47e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd5e195155894c8d7144580dc90fd47e columnFamilyName info 2023-02-09 06:03:37,334 INFO [StoreOpener-dd5e195155894c8d7144580dc90fd47e-1] regionserver.HStore(310): Store=dd5e195155894c8d7144580dc90fd47e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:37,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,337 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:37,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:37,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dd5e195155894c8d7144580dc90fd47e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69728886, jitterRate=0.039041370153427124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 06:03:37,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dd5e195155894c8d7144580dc90fd47e: Running coprocessor pre-open hook at 1675922617332Writing region info on filesystem at 1675922617332Initializing all the Stores at 1675922617332Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675922617332Cleaning up temporary data from old regions at 1675922617335 (+3 ms)Cleaning up detritus from prior splits at 1675922617336 (+1 ms)Running coprocessor post-open hooks at 1675922617339 (+3 ms)Region opened successfully at 1675922617339 2023-02-09 06:03:37,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e., pid=6, masterSystemTime=1675922617307 2023-02-09 06:03:37,343 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:37,343 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:37,344 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dd5e195155894c8d7144580dc90fd47e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:37,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675922617344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922617344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922617344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922617344"}]},"ts":"1675922617344"} 2023-02-09 06:03:37,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 06:03:37,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dd5e195155894c8d7144580dc90fd47e, server=jenkins-hbase4.apache.org,35495,1675922616397 in 190 msec 2023-02-09 06:03:37,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 06:03:37,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dd5e195155894c8d7144580dc90fd47e, ASSIGN in 346 msec 2023-02-09 06:03:37,348 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:37,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922617348"}]},"ts":"1675922617348"} 2023-02-09 06:03:37,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 06:03:37,352 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:37,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-09 06:03:37,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 06:03:37,369 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:37,369 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:37,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:37,373 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:37,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 06:03:37,379 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:37,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-09 06:03:37,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 06:03:37,392 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 06:03:37,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 06:03:37,398 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 06:03:37,401 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.952sec 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39071,1675922616351-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 06:03:37,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39071,1675922616351-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 06:03:37,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 06:03:37,443 DEBUG [Listener at localhost/36659] zookeeper.ReadOnlyZKClient(139): Connect 0x6b69468b to 127.0.0.1:61212 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:37,446 DEBUG [Listener at localhost/36659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78341251, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:37,447 DEBUG [hconnection-0x305d41bc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:37,448 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:37,450 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:37,450 DEBUG [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 06:03:37,450 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,450 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,453 DEBUG [Listener at localhost/36659] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 06:03:37,454 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 06:03:37,454 INFO [Listener at localhost/36659] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 06:03:37,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 06:03:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 06:03:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:37044 deadline: 1675922677454, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 06:03:37,455 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 06:03:37,456 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,456 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:37,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 06:03:37,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 06:03:37,459 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 06:03:37,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 06:03:37,460 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,460 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 06:03:37,460 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:37,461 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,462 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 empty. 2023-02-09 06:03:37,462 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,462 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 06:03:37,470 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 06:03:37,471 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => eee0447dc038c10413813db041c06f41, NAME => 'testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing eee0447dc038c10413813db041c06f41, disabling compactions & flushes 2023-02-09 06:03:37,476 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. after waiting 0 ms 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,476 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for eee0447dc038c10413813db041c06f41: Waiting for close lock at 1675922617476Disabling compacts and flushes for region at 1675922617476Disabling writes for close at 1675922617476Writing region close event to WAL at 1675922617476Closed at 1675922617476 2023-02-09 06:03:37,478 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 06:03:37,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675922617478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922617478"}]},"ts":"1675922617478"} 2023-02-09 06:03:37,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 06:03:37,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 06:03:37,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922617480"}]},"ts":"1675922617480"} 2023-02-09 06:03:37,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 06:03:37,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 06:03:37,486 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 06:03:37,486 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 06:03:37,486 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 06:03:37,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, ASSIGN}] 2023-02-09 06:03:37,487 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, ASSIGN 2023-02-09 06:03:37,487 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35495,1675922616397; forceNewPlan=false, retain=false 2023-02-09 06:03:37,561 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,561 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:37,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:37,637 INFO [jenkins-hbase4:39071] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 06:03:37,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=eee0447dc038c10413813db041c06f41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:37,638 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675922617638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922617638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922617638"}]},"ts":"1675922617638"} 2023-02-09 06:03:37,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure eee0447dc038c10413813db041c06f41, server=jenkins-hbase4.apache.org,35495,1675922616397}] 2023-02-09 06:03:37,719 INFO [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41387%2C1675922616418, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,41387,1675922616418, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs, maxLogs=32 2023-02-09 06:03:37,732 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK] 2023-02-09 06:03:37,732 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK] 2023-02-09 06:03:37,733 INFO [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/WALs/jenkins-hbase4.apache.org,41387,1675922616418/jenkins-hbase4.apache.org%2C41387%2C1675922616418.1675922617719 2023-02-09 06:03:37,734 DEBUG [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45797,DS-f7741c27-233a-4535-a884-d96d69144d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:36411,DS-8490cb44-d5f9-40db-8e8d-04ffec2bb3ef,DISK]] 2023-02-09 06:03:37,763 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:37,763 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:37,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eee0447dc038c10413813db041c06f41, NAME => 'testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.', STARTKEY => '', ENDKEY => ''} 2023-02-09 06:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,795 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,796 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1 2023-02-09 06:03:37,796 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1 2023-02-09 06:03:37,796 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eee0447dc038c10413813db041c06f41 columnFamilyName f1 2023-02-09 06:03:37,797 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(310): Store=eee0447dc038c10413813db041c06f41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:37,797 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,798 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2 2023-02-09 06:03:37,798 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2 2023-02-09 06:03:37,798 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eee0447dc038c10413813db041c06f41 columnFamilyName f2 2023-02-09 06:03:37,798 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(310): Store=eee0447dc038c10413813db041c06f41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:37,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:37,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eee0447dc038c10413813db041c06f41 2023-02-09 06:03:37,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 06:03:37,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eee0447dc038c10413813db041c06f41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73708735, jitterRate=0.09834574162960052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:37,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eee0447dc038c10413813db041c06f41: Running coprocessor pre-open hook at 1675922617794Writing region info on filesystem at 1675922617794Initializing all the Stores at 1675922617795 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922617795Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922617795Cleaning up temporary data from old regions at 1675922617800 (+5 ms)Cleaning up detritus from prior splits at 1675922617800Running coprocessor post-open hooks at 1675922617803 (+3 ms)Region opened successfully at 1675922617803 2023-02-09 06:03:37,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41., pid=12, masterSystemTime=1675922617791 2023-02-09 06:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:37,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=eee0447dc038c10413813db041c06f41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:37,805 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675922617805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675922617805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675922617805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675922617805"}]},"ts":"1675922617805"} 2023-02-09 06:03:37,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 06:03:37,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure eee0447dc038c10413813db041c06f41, server=jenkins-hbase4.apache.org,35495,1675922616397 in 168 msec 2023-02-09 06:03:37,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 06:03:37,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, ASSIGN in 323 msec 2023-02-09 06:03:37,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 06:03:37,811 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922617810"}]},"ts":"1675922617810"} 2023-02-09 06:03:37,812 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 06:03:37,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 06:03:37,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 355 msec 2023-02-09 06:03:38,064 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,064 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 06:03:38,066 INFO [Listener at localhost/36659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 06:03:38,066 DEBUG [Listener at localhost/36659] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 06:03:38,066 INFO [Listener at localhost/36659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:38,068 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 06:03:38,068 INFO [Listener at localhost/36659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 06:03:38,068 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 06:03:38,069 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 06:03:38,086 DEBUG [hconnection-0x305d41bc-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:38,097 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57958, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:38,104 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,173 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 06:03:38,186 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 06:03:38,186 INFO [Listener at localhost/36659] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 06:03:38,186 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,186 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:38,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675922618187 (current time:1675922618187). 2023-02-09 06:03:38,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 06:03:38,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] zookeeper.ReadOnlyZKClient(139): Connect 0x006eefcf to 127.0.0.1:61212 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 06:03:38,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d5088d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 06:03:38,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 06:03:38,193 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 06:03:38,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x006eefcf to 127.0.0.1:61212 2023-02-09 06:03:38,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:38,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 06:03:38,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:38,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:38,198 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:38,199 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675923218199 2023-02-09 06:03:38,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 06:03:38,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 06:03:38,204 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 06:03:38,204 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:38,204 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 06:03:38,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:38,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 8 msec 2023-02-09 06:03:38,206 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:38,206 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675923218206 2023-02-09 06:03:38,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-09 06:03:38,216 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-09 06:03:38,216 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:38,217 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-09 06:03:38,217 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 06:03:38,217 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,217 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,220 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:38,220 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:38,220 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:38,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:38,220 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,220 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 06:03:38,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 06:03:38,221 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 06:03:38,221 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:38,222 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:38,222 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 06:03:38,222 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 06:03:38,222 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 06:03:38,222 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41387,1675922616418' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 06:03:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 06:03:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 06:03:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35495,1675922616397' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 06:03:38,226 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,226 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:38,226 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,226 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,226 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:38,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,226 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,227 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:38,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35495,1675922616397' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-09 06:03:38,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@320f2134[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:38,228 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 06:03:38,228 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,229 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,229 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:38,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41387,1675922616418' in zk 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 06:03:38,231 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 06:03:38,231 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,231 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. started... 2023-02-09 06:03:38,231 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HRegion(2744): Flushing eee0447dc038c10413813db041c06f41 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 06:03:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 06:03:38,248 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f1/eb76f2c911db448e88e7380d884cab1d 2023-02-09 06:03:38,270 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f2/ad089124d1cc49e791835f6eb4fc67f2 2023-02-09 06:03:38,274 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f1/eb76f2c911db448e88e7380d884cab1d as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d 2023-02-09 06:03:38,278 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:38,279 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f2/ad089124d1cc49e791835f6eb4fc67f2 as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2 2023-02-09 06:03:38,282 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 06:03:38,283 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for eee0447dc038c10413813db041c06f41 in 52ms, sequenceid=5, compaction requested=false 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for eee0447dc038c10413813db041c06f41: 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d] hfiles 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d for snapshot=testWithMapReduceSingleRegion 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2] hfiles 2023-02-09 06:03:38,283 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2 for snapshot=testWithMapReduceSingleRegion 2023-02-09 06:03:38,294 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. completed. 2023-02-09 06:03:38,294 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,294 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 06:03:38,294 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 06:03:38,294 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,294 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 06:03:38,294 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35495,1675922616397' in zk 2023-02-09 06:03:38,297 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 06:03:38,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 06:03:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35495,1675922616397': 2023-02-09 06:03:38,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35495,1675922616397' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 06:03:38,300 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-09 06:03:38,301 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:38,301 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:38,301 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-09 06:03:38,301 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 06:03:38,303 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 06:03:38,303 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,303 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:38,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:38,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:38,305 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:38,305 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,305 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,305 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,306 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:38,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 06:03:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,306 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 06:03:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,307 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,307 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 06:03:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 06:03:38,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-09 06:03:38,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 06:03:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 06:03:38,317 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 06:03:38,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:38,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 06:03:38,317 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 06:03:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 06:03:38,318 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,318 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,318 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 06:03:38,318 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 06:03:38,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 06:03:38,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-09 06:03:38,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-09 06:03:38,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 06:03:38,349 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 06:03:38,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675922618201Consolidate snapshot: testWithMapReduceSingleRegion at 1675922618317 (+116 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675922618318 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1675922618320 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675922618326 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675922618349 (+23 ms) 2023-02-09 06:03:38,349 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 06:03:38,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 145 msec 2023-02-09 06:03:38,506 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 06:03:38,507 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,507 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 06:03:38,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 06:03:38,508 INFO [Listener at localhost/36659] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 06:03:38,508 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,508 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,512 INFO [Listener at localhost/36659] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 06:03:38,517 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 06:03:38,548 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,676 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 06:03:38,679 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,679 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,681 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 06:03:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 06:03:38,682 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 06:03:38,682 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:38,682 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 06:03:38,682 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 06:03:38,683 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,683 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,684 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:38,684 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:38,684 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:38,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:38,684 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,684 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 06:03:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 06:03:38,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:03:38,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41387,1675922616418' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 06:03:38,686 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 06:03:38,686 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,686 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. started... 2023-02-09 06:03:38,686 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eee0447dc038c10413813db041c06f41 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 06:03:38,687 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,687 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,688 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:38,701 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f1/2c58ab6627454f8db0ac7807580b709c 2023-02-09 06:03:38,722 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f2/d4c90fb0786847ebb34834fc9380566f 2023-02-09 06:03:38,727 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f1/2c58ab6627454f8db0ac7807580b709c as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/2c58ab6627454f8db0ac7807580b709c 2023-02-09 06:03:38,733 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/2c58ab6627454f8db0ac7807580b709c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:38,734 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/.tmp/f2/d4c90fb0786847ebb34834fc9380566f as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/d4c90fb0786847ebb34834fc9380566f 2023-02-09 06:03:38,738 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/d4c90fb0786847ebb34834fc9380566f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 06:03:38,739 INFO [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for eee0447dc038c10413813db041c06f41 in 53ms, sequenceid=9, compaction requested=false 2023-02-09 06:03:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eee0447dc038c10413813db041c06f41: 2023-02-09 06:03:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35495,1675922616397)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 06:03:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 06:03:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 06:03:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35495,1675922616397' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 06:03:38,741 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,741 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 06:03:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35495,1675922616397' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 06:03:38,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3630b3ad[Count = 0] remaining members to acquire global barrier 2023-02-09 06:03:38,744 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 06:03:38,744 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,745 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 06:03:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35495,1675922616397' in zk 2023-02-09 06:03:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41387,1675922616418' in zk 2023-02-09 06:03:38,747 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,35495,1675922616397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 06:03:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,41387,1675922616418' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 06:03:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35495,1675922616397': 2023-02-09 06:03:38,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35495,1675922616397' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 06:03:38,750 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 06:03:38,750 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 06:03:38,750 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 06:03:38,750 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 06:03:38,751 INFO [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 06:03:38,754 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 06:03:38,754 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:38,754 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 06:03:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:38,755 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 06:03:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,756 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 06:03:38,757 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 06:03:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 06:03:38,759 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 06:03:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 06:03:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 06:03:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:38,760 DEBUG [(jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 06:03:38,760 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 06:03:38,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 06:03:38,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 06:03:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 06:03:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 06:03:38,761 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 06:03:38,761 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 06:03:38,861 DEBUG [Listener at localhost/36659] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 06:03:38,861 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:38,861 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:38,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 06:03:38,958 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/hadoop-6862727592107011892.jar 2023-02-09 06:03:38,962 INFO [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675922618187 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:38,962 DEBUG [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161/data/default/testWithMapReduce 2023-02-09 06:03:38,963 INFO [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(239): region to add: eee0447dc038c10413813db041c06f41 2023-02-09 06:03:38,963 INFO [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(585): clone region=eee0447dc038c10413813db041c06f41 as eee0447dc038c10413813db041c06f41 in snapshot testWithMapReduceSingleRegion 2023-02-09 06:03:38,963 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => eee0447dc038c10413813db041c06f41, NAME => 'testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161 2023-02-09 06:03:38,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:38,970 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb76f2c911db448e88e7380d884cab1d from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 06:03:38,975 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ad089124d1cc49e791835f6eb4fc67f2 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 06:03:38,977 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing eee0447dc038c10413813db041c06f41, disabling compactions & flushes 2023-02-09 06:03:38,977 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,977 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,977 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. after waiting 0 ms 2023-02-09 06:03:38,977 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,977 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:38,978 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for eee0447dc038c10413813db041c06f41: Waiting for close lock at 1675922618977Disabling compacts and flushes for region at 1675922618977Disabling writes for close at 1675922618977Writing region close event to WAL at 1675922618977Closed at 1675922618977 2023-02-09 06:03:38,978 INFO [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675922618187 type: FLUSH version: 2 ttl: 0 2023-02-09 06:03:38,978 DEBUG [Listener at localhost/36659] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161 2023-02-09 06:03:38,978 DEBUG [Listener at localhost/36659] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161 2023-02-09 06:03:38,978 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |-data/ 2023-02-09 06:03:38,979 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |----default/ 2023-02-09 06:03:38,979 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 06:03:38,979 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |----------eee0447dc038c10413813db041c06f41/ 2023-02-09 06:03:38,980 DEBUG [Listener at localhost/36659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 06:03:38,980 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 06:03:38,980 DEBUG [Listener at localhost/36659] util.CommonFSUtils(702): |----------------testWithMapReduce=eee0447dc038c10413813db041c06f41-eb76f2c911db448e88e7380d884cab1d 2023-02-09 06:03:38,980 DEBUG [Listener at localhost/36659] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 06:03:38,980 DEBUG [Listener at localhost/36659] util.CommonFSUtils(702): |----------------testWithMapReduce=eee0447dc038c10413813db041c06f41-ad089124d1cc49e791835f6eb4fc67f2 2023-02-09 06:03:38,981 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,981 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,982 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,982 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,983 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,983 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:38,983 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,049 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/hadoop-1872919600990040594.jar 2023-02-09 06:03:39,050 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,050 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,050 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,050 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,051 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,051 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,051 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 06:03:39,052 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 06:03:39,052 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 06:03:39,052 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 06:03:39,053 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 06:03:39,053 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 06:03:39,053 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 06:03:39,054 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 06:03:39,054 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 06:03:39,055 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 06:03:39,055 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 06:03:39,055 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:39,056 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:39,056 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 06:03:39,056 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:39,122 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/hadoop-2373676291671651173.jar 2023-02-09 06:03:39,122 DEBUG [Listener at localhost/36659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 06:03:39,127 WARN [Listener at localhost/36659] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 06:03:39,157 INFO [Listener at localhost/36659] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 06:03:39,238 WARN [Listener at localhost/36659] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/mapreduce.cluster.local.dir/1675922619203/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 06:03:39,238 WARN [Listener at localhost/36659] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/mapreduce.cluster.local.dir/1675922619203/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 06:03:39,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 06:03:39,269 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 06:03:39,270 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 06:03:39,271 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eee0447dc038c10413813db041c06f41 2023-02-09 06:03:39,272 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1 2023-02-09 06:03:39,273 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eee0447dc038c10413813db041c06f41 columnFamilyName f1 2023-02-09 06:03:39,277 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(539): loaded hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/testWithMapReduce=eee0447dc038c10413813db041c06f41-eb76f2c911db448e88e7380d884cab1d 2023-02-09 06:03:39,277 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(310): Store=eee0447dc038c10413813db041c06f41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:39,277 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eee0447dc038c10413813db041c06f41 2023-02-09 06:03:39,278 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2 2023-02-09 06:03:39,278 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eee0447dc038c10413813db041c06f41 columnFamilyName f2 2023-02-09 06:03:39,282 DEBUG [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(539): loaded hdfs://localhost:44309/user/jenkins/test-data/ec08b5c3-df9c-7ebb-1b9d-1a26caab65ef/testWithMapReduceSingleRegion/fcdf6a26-7ca3-4bd2-81c1-3a5bcb844161/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/testWithMapReduce=eee0447dc038c10413813db041c06f41-ad089124d1cc49e791835f6eb4fc67f2 2023-02-09 06:03:39,282 INFO [StoreOpener-eee0447dc038c10413813db041c06f41-1] regionserver.HStore(310): Store=eee0447dc038c10413813db041c06f41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 06:03:39,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 06:03:39,283 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened eee0447dc038c10413813db041c06f41; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67759454, jitterRate=0.009694546461105347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 06:03:39,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for eee0447dc038c10413813db041c06f41: Writing region info on filesystem at 1675922619270Initializing all the Stores at 1675922619270Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922619271 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675922619271Region opened successfully at 1675922619283 (+12 ms) 2023-02-09 06:03:39,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing eee0447dc038c10413813db041c06f41, disabling compactions & flushes 2023-02-09 06:03:39,368 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:39,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:39,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. after waiting 0 ms 2023-02-09 06:03:39,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:39,369 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:39,369 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for eee0447dc038c10413813db041c06f41: Waiting for close lock at 1675922619368Disabling compacts and flushes for region at 1675922619368Disabling writes for close at 1675922619368Writing region close event to WAL at 1675922619369 (+1 ms)Closed at 1675922619369 2023-02-09 06:03:40,271 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,271 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-09 06:03:40,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-09 06:03:40,276 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,276 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,276 INFO [Listener at localhost/36659] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 06:03:40,277 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 06:03:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,279 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,279 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922620279"}]},"ts":"1675922620279"} 2023-02-09 06:03:40,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:40,281 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 06:03:40,282 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 06:03:40,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, UNASSIGN}] 2023-02-09 06:03:40,283 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, UNASSIGN 2023-02-09 06:03:40,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=eee0447dc038c10413813db041c06f41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:40,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675922620283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675922620283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675922620283"}]},"ts":"1675922620283"} 2023-02-09 06:03:40,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure eee0447dc038c10413813db041c06f41, server=jenkins-hbase4.apache.org,35495,1675922616397}] 2023-02-09 06:03:40,380 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,380 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:40,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close eee0447dc038c10413813db041c06f41 2023-02-09 06:03:40,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eee0447dc038c10413813db041c06f41, disabling compactions & flushes 2023-02-09 06:03:40,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:40,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:40,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. after waiting 0 ms 2023-02-09 06:03:40,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:40,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 06:03:40,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41. 2023-02-09 06:03:40,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eee0447dc038c10413813db041c06f41: Waiting for close lock at 1675922620437Running coprocessor pre-close hooks at 1675922620437Disabling compacts and flushes for region at 1675922620437Disabling writes for close at 1675922620437Writing region close event to WAL at 1675922620438 (+1 ms)Running coprocessor post-close hooks at 1675922620441 (+3 ms)Closed at 1675922620442 (+1 ms) 2023-02-09 06:03:40,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed eee0447dc038c10413813db041c06f41 2023-02-09 06:03:40,443 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=eee0447dc038c10413813db041c06f41, regionState=CLOSED 2023-02-09 06:03:40,444 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675922620443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675922620443"}]},"ts":"1675922620443"} 2023-02-09 06:03:40,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 06:03:40,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure eee0447dc038c10413813db041c06f41, server=jenkins-hbase4.apache.org,35495,1675922616397 in 160 msec 2023-02-09 06:03:40,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 06:03:40,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eee0447dc038c10413813db041c06f41, UNASSIGN in 164 msec 2023-02-09 06:03:40,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675922620447"}]},"ts":"1675922620447"} 2023-02-09 06:03:40,448 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 06:03:40,449 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 06:03:40,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 173 msec 2023-02-09 06:03:40,549 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:40,549 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 06:03:40,582 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,582 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 06:03:40,583 INFO [Listener at localhost/36659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-09 06:03:40,583 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,583 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 06:03:40,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,586 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,586 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,587 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:40,590 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:40,591 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/recovered.edits] 2023-02-09 06:03:40,594 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/2c58ab6627454f8db0ac7807580b709c to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/archive/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/2c58ab6627454f8db0ac7807580b709c 2023-02-09 06:03:40,595 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/archive/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f1/eb76f2c911db448e88e7380d884cab1d 2023-02-09 06:03:40,597 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2 to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/archive/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/ad089124d1cc49e791835f6eb4fc67f2 2023-02-09 06:03:40,598 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/d4c90fb0786847ebb34834fc9380566f to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/archive/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/f2/d4c90fb0786847ebb34834fc9380566f 2023-02-09 06:03:40,600 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/recovered.edits/12.seqid to hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/archive/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41/recovered.edits/12.seqid 2023-02-09 06:03:40,600 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/.tmp/data/default/testWithMapReduce/eee0447dc038c10413813db041c06f41 2023-02-09 06:03:40,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 06:03:40,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,603 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-09 06:03:40,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 06:03:40,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 06:03:40,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675922620606"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:40,607 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 06:03:40,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eee0447dc038c10413813db041c06f41, NAME => 'testWithMapReduce,,1675922617457.eee0447dc038c10413813db041c06f41.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 06:03:40,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 06:03:40,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675922620607"}]},"ts":"9223372036854775807"} 2023-02-09 06:03:40,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 06:03:40,609 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 06:03:40,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 25 msec 2023-02-09 06:03:40,687 INFO [Listener at localhost/36659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 06:03:40,688 INFO [Listener at localhost/36659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 06:03:40,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39071] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 06:03:40,689 INFO [Listener at localhost/36659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-09 06:03:40,689 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 06:03:40,689 INFO [Listener at localhost/36659] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 06:03:40,689 DEBUG [Listener at localhost/36659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b69468b to 127.0.0.1:61212 2023-02-09 06:03:40,689 DEBUG [Listener at localhost/36659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,689 DEBUG [Listener at localhost/36659] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 06:03:40,689 DEBUG [Listener at localhost/36659] util.JVMClusterUtil(257): Found active master hash=1291338310, stopped=false 2023-02-09 06:03:40,689 INFO [Listener at localhost/36659] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:40,692 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:40,692 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:40,692 INFO [Listener at localhost/36659] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 06:03:40,692 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 06:03:40,693 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:40,694 DEBUG [Listener at localhost/36659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cafdf8e to 127.0.0.1:61212 2023-02-09 06:03:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 06:03:40,694 DEBUG [Listener at localhost/36659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,694 INFO [Listener at localhost/36659] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35495,1675922616397' ***** 2023-02-09 06:03:40,695 INFO [Listener at localhost/36659] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:40,695 INFO [Listener at localhost/36659] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41387,1675922616418' ***** 2023-02-09 06:03:40,695 INFO [Listener at localhost/36659] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 06:03:40,695 INFO [RS:0;jenkins-hbase4:35495] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:40,695 INFO [RS:1;jenkins-hbase4:41387] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 06:03:40,695 INFO [RS:0;jenkins-hbase4:35495] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:40,695 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:40,695 INFO [RS:0;jenkins-hbase4:35495] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:40,695 INFO [RS:1;jenkins-hbase4:41387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 06:03:40,696 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(3304): Received CLOSE for dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:40,695 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 06:03:40,696 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:40,696 INFO [RS:1;jenkins-hbase4:41387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 06:03:40,697 DEBUG [RS:0;jenkins-hbase4:35495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23eadaab to 127.0.0.1:61212 2023-02-09 06:03:40,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dd5e195155894c8d7144580dc90fd47e, disabling compactions & flushes 2023-02-09 06:03:40,697 DEBUG [RS:0;jenkins-hbase4:35495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,697 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:40,697 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 06:03:40,698 DEBUG [RS:1;jenkins-hbase4:41387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15431cfb to 127.0.0.1:61212 2023-02-09 06:03:40,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:40,698 DEBUG [RS:1;jenkins-hbase4:41387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,698 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1479): Online Regions={dd5e195155894c8d7144580dc90fd47e=hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e.} 2023-02-09 06:03:40,698 INFO [RS:1;jenkins-hbase4:41387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:40,698 INFO [RS:1;jenkins-hbase4:41387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:40,698 DEBUG [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1505): Waiting on dd5e195155894c8d7144580dc90fd47e 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:40,698 INFO [RS:1;jenkins-hbase4:41387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. after waiting 0 ms 2023-02-09 06:03:40,698 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:40,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing dd5e195155894c8d7144580dc90fd47e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 06:03:40,698 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 06:03:40,698 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 06:03:40,698 DEBUG [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 06:03:40,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 06:03:40,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 06:03:40,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-09 06:03:40,699 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:40,699 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:40,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/.tmp/info/8e572c5711f7489a98ef01d4e06d94fc 2023-02-09 06:03:40,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/info/9dcbf3389c6e409c931703d9c62b10cd 2023-02-09 06:03:40,721 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 06:03:40,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/.tmp/info/8e572c5711f7489a98ef01d4e06d94fc as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/info/8e572c5711f7489a98ef01d4e06d94fc 2023-02-09 06:03:40,721 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 06:03:40,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9dcbf3389c6e409c931703d9c62b10cd 2023-02-09 06:03:40,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/info/8e572c5711f7489a98ef01d4e06d94fc, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 06:03:40,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/rep_barrier/37f5f7483e804c4ab4903b49221e7263 2023-02-09 06:03:40,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dd5e195155894c8d7144580dc90fd47e in 32ms, sequenceid=6, compaction requested=false 2023-02-09 06:03:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/namespace/dd5e195155894c8d7144580dc90fd47e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 06:03:40,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37f5f7483e804c4ab4903b49221e7263 2023-02-09 06:03:40,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:40,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dd5e195155894c8d7144580dc90fd47e: Waiting for close lock at 1675922620696Running coprocessor pre-close hooks at 1675922620696Disabling compacts and flushes for region at 1675922620696Disabling writes for close at 1675922620698 (+2 ms)Obtaining lock to block concurrent updates at 1675922620698Preparing flush snapshotting stores in dd5e195155894c8d7144580dc90fd47e at 1675922620698Finished memstore snapshotting hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675922620698Flushing stores of hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. at 1675922620700 (+2 ms)Flushing dd5e195155894c8d7144580dc90fd47e/info: creating writer at 1675922620700Flushing dd5e195155894c8d7144580dc90fd47e/info: appending metadata at 1675922620702 (+2 ms)Flushing dd5e195155894c8d7144580dc90fd47e/info: closing flushed file at 1675922620702Flushing dd5e195155894c8d7144580dc90fd47e/info: reopening flushed file at 1675922620725 (+23 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dd5e195155894c8d7144580dc90fd47e in 32ms, sequenceid=6, compaction requested=false at 1675922620730 (+5 ms)Writing region close event to WAL at 1675922620731 (+1 ms)Running coprocessor post-close hooks at 1675922620734 (+3 ms)Closed at 1675922620735 (+1 ms) 2023-02-09 06:03:40,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675922616967.dd5e195155894c8d7144580dc90fd47e. 2023-02-09 06:03:40,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/table/afeca64f8b5348b48ffb5ca5bf952c8d 2023-02-09 06:03:40,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afeca64f8b5348b48ffb5ca5bf952c8d 2023-02-09 06:03:40,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/info/9dcbf3389c6e409c931703d9c62b10cd as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/info/9dcbf3389c6e409c931703d9c62b10cd 2023-02-09 06:03:40,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9dcbf3389c6e409c931703d9c62b10cd 2023-02-09 06:03:40,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/info/9dcbf3389c6e409c931703d9c62b10cd, entries=12, sequenceid=21, filesize=6.2 K 2023-02-09 06:03:40,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/rep_barrier/37f5f7483e804c4ab4903b49221e7263 as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/rep_barrier/37f5f7483e804c4ab4903b49221e7263 2023-02-09 06:03:40,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37f5f7483e804c4ab4903b49221e7263 2023-02-09 06:03:40,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/rep_barrier/37f5f7483e804c4ab4903b49221e7263, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 06:03:40,754 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/.tmp/table/afeca64f8b5348b48ffb5ca5bf952c8d as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/table/afeca64f8b5348b48ffb5ca5bf952c8d 2023-02-09 06:03:40,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afeca64f8b5348b48ffb5ca5bf952c8d 2023-02-09 06:03:40,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/table/afeca64f8b5348b48ffb5ca5bf952c8d, entries=4, sequenceid=21, filesize=5.0 K 2023-02-09 06:03:40,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-09 06:03:40,759 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 06:03:40,759 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 06:03:40,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 06:03:40,762 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 06:03:40,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:40,763 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675922620698Running coprocessor pre-close hooks at 1675922620698Disabling compacts and flushes for region at 1675922620698Disabling writes for close at 1675922620698Obtaining lock to block concurrent updates at 1675922620698Preparing flush snapshotting stores in 1588230740 at 1675922620698Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675922620699 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675922620699Flushing 1588230740/info: creating writer at 1675922620699Flushing 1588230740/info: appending metadata at 1675922620702 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675922620702Flushing 1588230740/rep_barrier: creating writer at 1675922620722 (+20 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675922620724 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675922620724Flushing 1588230740/table: creating writer at 1675922620735 (+11 ms)Flushing 1588230740/table: appending metadata at 1675922620737 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675922620737Flushing 1588230740/info: reopening flushed file at 1675922620746 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675922620751 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675922620755 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false at 1675922620758 (+3 ms)Writing region close event to WAL at 1675922620759 (+1 ms)Running coprocessor post-close hooks at 1675922620762 (+3 ms)Closed at 1675922620763 (+1 ms) 2023-02-09 06:03:40,763 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 06:03:40,898 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35495,1675922616397; all regions closed. 2023-02-09 06:03:40,898 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41387,1675922616418; all regions closed. 2023-02-09 06:03:40,902 DEBUG [RS:0;jenkins-hbase4:35495] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs 2023-02-09 06:03:40,902 DEBUG [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs 2023-02-09 06:03:40,902 INFO [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41387%2C1675922616418.meta:.meta(num 1675922616921) 2023-02-09 06:03:40,902 INFO [RS:0;jenkins-hbase4:35495] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35495%2C1675922616397:(num 1675922617314) 2023-02-09 06:03:40,902 DEBUG [RS:0;jenkins-hbase4:35495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,902 INFO [RS:0;jenkins-hbase4:35495] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:40,902 INFO [RS:0;jenkins-hbase4:35495] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:40,903 INFO [RS:0;jenkins-hbase4:35495] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 06:03:40,903 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:40,903 INFO [RS:0;jenkins-hbase4:35495] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 06:03:40,903 INFO [RS:0;jenkins-hbase4:35495] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 06:03:40,904 INFO [RS:0;jenkins-hbase4:35495] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35495 2023-02-09 06:03:40,906 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:40,906 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:40,906 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:40,906 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35495,1675922616397 2023-02-09 06:03:40,906 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:40,906 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35495,1675922616397] 2023-02-09 06:03:40,906 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35495,1675922616397; numProcessing=1 2023-02-09 06:03:40,907 DEBUG [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/oldWALs 2023-02-09 06:03:40,907 INFO [RS:1;jenkins-hbase4:41387] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41387%2C1675922616418:(num 1675922617719) 2023-02-09 06:03:40,907 DEBUG [RS:1;jenkins-hbase4:41387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,907 INFO [RS:1;jenkins-hbase4:41387] regionserver.LeaseManager(133): Closed leases 2023-02-09 06:03:40,907 INFO [RS:1;jenkins-hbase4:41387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 06:03:40,907 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:40,909 INFO [RS:1;jenkins-hbase4:41387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41387 2023-02-09 06:03:40,910 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35495,1675922616397 already deleted, retry=false 2023-02-09 06:03:40,910 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35495,1675922616397 expired; onlineServers=1 2023-02-09 06:03:40,916 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 06:03:40,916 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41387,1675922616418 2023-02-09 06:03:40,916 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b1139bf rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:40,917 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41387,1675922616418] 2023-02-09 06:03:40,917 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41387,1675922616418; numProcessing=2 2023-02-09 06:03:40,918 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41387,1675922616418 already deleted, retry=false 2023-02-09 06:03:40,918 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41387,1675922616418 expired; onlineServers=0 2023-02-09 06:03:40,918 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39071,1675922616351' ***** 2023-02-09 06:03:40,918 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 06:03:40,919 DEBUG [M:0;jenkins-hbase4:39071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48c7df01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 06:03:40,919 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39071,1675922616351 2023-02-09 06:03:40,919 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39071,1675922616351; all regions closed. 2023-02-09 06:03:40,919 DEBUG [M:0;jenkins-hbase4:39071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 06:03:40,919 DEBUG [M:0;jenkins-hbase4:39071] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 06:03:40,919 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 06:03:40,919 DEBUG [M:0;jenkins-hbase4:39071] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 06:03:40,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922616571] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675922616571,5,FailOnTimeoutGroup] 2023-02-09 06:03:40,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922616571] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675922616571,5,FailOnTimeoutGroup] 2023-02-09 06:03:40,919 INFO [M:0;jenkins-hbase4:39071] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 06:03:40,920 INFO [M:0;jenkins-hbase4:39071] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 06:03:40,921 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 06:03:40,921 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 06:03:40,921 INFO [M:0;jenkins-hbase4:39071] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 06:03:40,921 DEBUG [M:0;jenkins-hbase4:39071] master.HMaster(1502): Stopping service threads 2023-02-09 06:03:40,921 INFO [M:0;jenkins-hbase4:39071] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 06:03:40,921 ERROR [M:0;jenkins-hbase4:39071] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 06:03:40,922 INFO [M:0;jenkins-hbase4:39071] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 06:03:40,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 06:03:40,922 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 06:03:40,922 DEBUG [M:0;jenkins-hbase4:39071] zookeeper.ZKUtil(398): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 06:03:40,922 WARN [M:0;jenkins-hbase4:39071] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 06:03:40,922 INFO [M:0;jenkins-hbase4:39071] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 06:03:40,923 INFO [M:0;jenkins-hbase4:39071] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 06:03:40,923 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 06:03:40,923 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:40,923 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:40,923 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 06:03:40,923 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:40,923 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.66 KB 2023-02-09 06:03:40,936 INFO [M:0;jenkins-hbase4:39071] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bf022e8992b64a4b8811521893904db0 2023-02-09 06:03:40,940 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bf022e8992b64a4b8811521893904db0 as hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bf022e8992b64a4b8811521893904db0 2023-02-09 06:03:40,944 INFO [M:0;jenkins-hbase4:39071] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/d5231dc1-165c-05d0-452b-4307a0b848fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bf022e8992b64a4b8811521893904db0, entries=17, sequenceid=132, filesize=8.6 K 2023-02-09 06:03:40,944 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/55998, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-09 06:03:40,945 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 06:03:40,945 DEBUG [M:0;jenkins-hbase4:39071] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675922620923Disabling compacts and flushes for region at 1675922620923Disabling writes for close at 1675922620923Obtaining lock to block concurrent updates at 1675922620923Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675922620923Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55998, getHeapSize=67216, getOffHeapSize=0, getCellsCount=145 at 1675922620923Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675922620924 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675922620924Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675922620926 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675922620926Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675922620940 (+14 ms)Finished flush of dataSize ~54.69 KB/55998, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false at 1675922620944 (+4 ms)Writing region close event to WAL at 1675922620945 (+1 ms)Closed at 1675922620945 2023-02-09 06:03:40,949 INFO [M:0;jenkins-hbase4:39071] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 06:03:40,949 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 06:03:40,949 INFO [M:0;jenkins-hbase4:39071] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39071 2023-02-09 06:03:40,951 DEBUG [M:0;jenkins-hbase4:39071] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39071,1675922616351 already deleted, retry=false 2023-02-09 06:03:41,193 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,193 INFO [M:0;jenkins-hbase4:39071] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39071,1675922616351; zookeeper connection closed. 2023-02-09 06:03:41,193 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bae4195 rejected from java.util.concurrent.ThreadPoolExecutor@5f91de38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,194 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): master:39071-0x10037ad99cf0000, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,194 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2486e41 rejected from java.util.concurrent.ThreadPoolExecutor@5f91de38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,293 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,293 INFO [RS:1;jenkins-hbase4:41387] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41387,1675922616418; zookeeper connection closed. 2023-02-09 06:03:41,293 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7972c8d7 rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,294 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:41387-0x10037ad99cf0002, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,294 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1787f73 rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,294 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf 2023-02-09 06:03:41,394 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,394 INFO [RS:0;jenkins-hbase4:35495] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35495,1675922616397; zookeeper connection closed. 2023-02-09 06:03:41,394 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58d35fb5 rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,394 DEBUG [Listener at localhost/36659-EventThread] zookeeper.ZKWatcher(600): regionserver:35495-0x10037ad99cf0001, quorum=127.0.0.1:61212, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 06:03:41,394 ERROR [Listener at localhost/36659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a511937 rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 06:03:41,394 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8ea043c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8ea043c 2023-02-09 06:03:41,394 INFO [Listener at localhost/36659] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 06:03:41,394 WARN [Listener at localhost/36659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:41,398 INFO [Listener at localhost/36659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:41,503 WARN [BP-2049257243-172.31.14.131-1675922615776 heartbeating to localhost/127.0.0.1:44309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:41,503 WARN [BP-2049257243-172.31.14.131-1675922615776 heartbeating to localhost/127.0.0.1:44309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2049257243-172.31.14.131-1675922615776 (Datanode Uuid 5f4c651c-fdcf-4262-be39-756a8a7ff004) service to localhost/127.0.0.1:44309 2023-02-09 06:03:41,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/dfs/data/data3/current/BP-2049257243-172.31.14.131-1675922615776] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:41,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/dfs/data/data4/current/BP-2049257243-172.31.14.131-1675922615776] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:41,505 WARN [Listener at localhost/36659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 06:03:41,508 INFO [Listener at localhost/36659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:41,609 WARN [BP-2049257243-172.31.14.131-1675922615776 heartbeating to localhost/127.0.0.1:44309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 06:03:41,609 WARN [BP-2049257243-172.31.14.131-1675922615776 heartbeating to localhost/127.0.0.1:44309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2049257243-172.31.14.131-1675922615776 (Datanode Uuid 4ce7a7f2-f149-4c94-aeb5-251a707e1a81) service to localhost/127.0.0.1:44309 2023-02-09 06:03:41,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/dfs/data/data1/current/BP-2049257243-172.31.14.131-1675922615776] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:41,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/507473b7-8ad9-b44c-b590-33fe2f8460d1/cluster_42ce61ae-35c4-5a21-48b4-604d3b05b374/dfs/data/data2/current/BP-2049257243-172.31.14.131-1675922615776] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 06:03:41,620 INFO [Listener at localhost/36659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 06:03:41,732 INFO [Listener at localhost/36659] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 06:03:41,748 INFO [Listener at localhost/36659] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 06:03:41,761 INFO [Listener at localhost/36659] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=291 (was 271) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44309 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36659 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44309 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44309 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:44309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:44309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39071,1675922616351)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44309 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=604 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3309 (was 3352)